{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"17948efc-2fb0-5ae9-91a2-aedc26195a15","task_key":"default--validation--13561","task_revision_id":"1","upstream_id":"13561","short_description":"HellaSwag validation 13561","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to avoid clothes creasing during wear [title] Wait until your clothes have cooled to wear them. [step] Fabrics most easily crease when they are still damp or warm. Be sure that your clothes are room temperature and completely dry before putting them on.\",\"endings\":\"[\\\"[substeps] If you buy dry clothes, make sure that they are cleaned before putting them on. [title] Don't worry about how they crease.\\\", \\\"[substeps] Just as you don't want to put on clothes that are still warm from the dryer, try to avoid getting wet or sweaty during the day. This will cause your clothes to crease.\\\", \\\"[title] Dab some fingernail polish remover to a cotton ball and make sure it's particularly moist, but not dripping. [step] You will squeeze the excess moisture out of your clothes once they've cooled down.\\\", \\\"[substeps] If you are hanging them up, don't dry them until they have totally cooled. Sitting or hanging them on the clothesline has high risks of letting the fabric rip while in extreme weather.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}