{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6ed28e69-c488-5816-bd5b-c4559e9389d9","task_key":"default--validation--9739","task_revision_id":"1","upstream_id":"9739","short_description":"HellaSwag validation 9739","config":"default","split":"validation","body":"{\"activity_label\":\"Work World\",\"ctx\":\"[header] How to calculate alaska unemployment [title] Make sure you are eligible to collect alaska unemployment benefits. [substeps] Check whether your employer was subject to unemployment insurance laws. If so, you participated in \\\" covered employment.\",\"endings\":\"['\\\" if you engaged in unpaid work for less than the minimum wage, then you can collect $200 , 000 and it is less than 2000 miles (115 km) from your home. You also must notify the state government, which will process your charge.', '\\\" if you worked as a contract or seasonal employee, you might not have been covered. If your employer is registered with the alaska department of labor, you are likely covered.', '\\\" if your employer told you not to do so, then the period after qualifying for unemployment insurance benefits will be considered \\\" covered by the statute of limitations. \\\" your employer must have an uncovered status for you to collect enough unemployment benefits to cover the costs of getting a car, rent, and transportation expenses covered by the statute of limitations and monthly payments.', '\\\" those laws violate their federal and state regulation with least one qualification. You are not eligible to collect unemployment benefits through a federal agency agency.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}