{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"61527b96-3a04-587f-870d-f3e10aadf73f","task_key":"default--validation--36822--variant-a4aae34879e9","task_revision_id":"1","upstream_id":"36822--variant-a4aae34879e9","short_description":"HellaSwag validation 36822","config":"default","split":"validation","body":"{\"activity_label\":\"Sports and Fitness\",\"ctx\":\"[header] How to get a gun license in georgia [title] Meet the age requirement. [step] You must be at least 21 years of age to get a gun license in georgia. However, if you've been in the armed forces, you can apply at age 18 if you have completed basic training and can provide proof that you are either on active duty or have been honorably discharged.\",\"endings\":\"['[substeps] To qualify for a gun license, you must be at least 18 years of age. If you were in the military or had engaged in active duty, you may be disabled in the military for at least one year.', \\\"[title] Obtain a copy of the national firearms dealer license issued in 1961 if necessary. [step] You can find a copy of this licensing through the sheriff's department, local evidence station, or the department of gun control in various cities or counties.\\\", 'If you have completed training, you must be mentally capable of fulfilling these requirements. You can find the same information on the georgia department of motor vehicles (dmv) website.', \\\"[title] Check if you have a felony conviction. [step] You can't get a gun license if you have a felony conviction in georgia or in any other state.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}