{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"452040e8-cd1d-5d2b-acad-0fd5a0235f12","task_key":"default--validation--5705","task_revision_id":"1","upstream_id":"5705","short_description":"HellaSwag validation 5705","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to accomplish more with your master list [title] Create your master list-this is simply a brain dump of everything you want/have to do. [step] It can contain 20 , 30 , 50 + items. [title] Create your daily' to-do' list.\",\"endings\":\"['[step] For example, every morning start your day with coffee, your breakfast, lunch, and maybe snacks. Skip this in later days if you can because its hard to read instead of looking at your list, or is too much of a challenge.', \\\"[step] Write down a list of things you're going to have to do on your master list each day, including school, work, the kids visit, chores, plans for the upcoming month, etc. To help you think of each day ahead of time, write or look up associated goals.\\\", '[step] Examples of days should come first and days last. For example, you might have monday by 12:30am, tuesday by 2:45pm, and friday by 5:00 pm.', '[step] This is the list of things you want to achieve today. Items on this list may come from your master list or may be a result of events from the previous day.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}