{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"13052c7b-653e-582a-b4e3-63b544e18657","task_key":"default--validation--40019","task_revision_id":"1","upstream_id":"40019","short_description":"HellaSwag validation 40019","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to care for your feet and toenails [title] Make sure to wash your feet daily. [step] Feet tend to get dirtier and sweatier than other parts of the body, so it's important to have good sanitary habits. If you take showers in the morning and not at night, at least make feet-washing a part of your nightly routine when you get home.\",\"endings\":\"[\\\"[title] If you want to give your feet a break from everyday life, get your toenails waxed. [step] They don't have to be pristine to be waxed.\\\", '[substeps] Have a toothbrush and cotton wipes handy for use with your feet and toenails. [title] Make sure your toenails are always clean.', '[substeps] If you have psittacosis, you can go easy on those feet. Take a shower once daily-once a day-during winter, and once a day while in the spring or summer if your weather allows.', 'Aside from being a mark of good hygiene, doing this also stops you from carrying dirt into your bed. [substeps] Wash them with soap and warm water.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}