{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"96aa51a7-dee4-5ac4-801d-03f99a9fabb9","task_key":"default--validation--14277","task_revision_id":"1","upstream_id":"14277","short_description":"HellaSwag validation 14277","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to size a waist cincher [title] Choose a waist training corset if you want a very small waist. [step] If you want a very small waist or an extreme hourglass figure, you'll need a full waist-training corset with boning. Boning is interior structure similar to the underwire on a brassiere.\",\"endings\":\"['Waist-training corset can make your waist look smaller and also offer a cinching effect. [title] Layer on a belt for a more defined waist.', 'You should choose a corset with hems or ruffles to further enhance your waistline. [substeps] Boning is the material that displays your waist.', \\\"It's what holds your waist in tight. Corsets need to be purchased from specialty shops--you will not be able to find them in your local lingerie department.\\\", 'Boning does have some reinforced or stretchy tissue you can simply melt into your corset to make it expand. [substeps] This is not a necessity if you want to cover up or pack on some padding.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}