{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fbc647ae-461f-5055-ab42-14b1cff40d2d","task_key":"default--validation--5251","task_revision_id":"1","upstream_id":"5251","short_description":"HellaSwag validation 5251","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make an a + project display board [title] Know the rules and/or regulations. [step] If you are creating a display board for a science fair or school event, there may be certain items that are required to be on your board. Make sure you know what these items are so you can prepare and plan for them.\",\"endings\":\"['[substeps] All materials are required to be displayed. These items are calculated using tools like the periodic table or the board settings function.', '[substeps] If you are making an appliance for a construction project, then you may be required to find and start working on your own. If you are designing a poster board for a babysitting program, then that could help you put together your own poster board.', 'Your ideas will also depend on what you will be wearing on the board. [substeps] Keep a free-form picture board that you hang up on your wall.', \\\"[substeps] Items may include: your name, your grade level, your teacher's name, acknowledgements, etc. You may also be required to display items beside, but not on, the board, such as lab notes, equipment, examples or prototypes, etc.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}