{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1101b349-bba3-5b2e-9fd0-e6cc191247e0","task_key":"default--validation--42698","task_revision_id":"1","upstream_id":"42698","short_description":"HellaSwag validation 42698","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to get workers compensation insurance [title] Determine whether a business must purchase workers' compensation insurance. [step] Each state administers its own workers' compensation program. The purpose behind workers' compensation insurance is to give injured or ill workers immediate financial relief for at least a portion of their wages while they are unable to work.\",\"endings\":\"[\\\"As a result, employees may have to invest a significant portion of their total expected wage in the work they do. In some areas, the amount of time that employee must have workers' compensation insurance is less than the amount of wages they generate on a daily basis in a single year.\\\", \\\"[substeps] In order to determine whether an employer must buy employees' compensation insurance, it must first determine whether a business must purchase workers' compensation insurance. When another business brings workers' compensation insurance to him, the employer may wonder what sort of policy will help him out.\\\", \\\"As a general rule, any business that hires employees who are not also owners of the business must obtain workers' compensation insurance. [substeps] There may be severe penalties for businesses or employers who fail to maintain workers' compensation insurance for their employees as required.\\\", \\\"States may require workers' compensation insurance based on the business' economic needs. [substeps] States such as maryland provide the premium on worker's compensation insurance for businesses over 45 years of age and older.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}