{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"097ba571-2700-529f-a0b2-ff772144628f","task_key":"default--validation--10006","task_revision_id":"1","upstream_id":"10006","short_description":"HellaSwag validation 10006","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to become an anesthesiologist [title] Get your high school diploma or equivalent. [step] You'll need to do one of these things to get into college or university. Take high school courses in biology, chemistry, and physics to prepare for a pre-med major in college.\",\"endings\":\"['[substeps] There are usually a number of different careers going into med schools, including biological foundations, biochemistry, state medicine, and human reproduction. Though each of these fields are different, one major for seasoned anesthesisiers is biochemistry.', 'Challenge yourself by taking hard courses and getting good grades to impress both college and medical school admissions officers. [substeps] Enroll in ap science courses if you live in the us or canada or gcse or a level courses in the uk.', 'The natural resources administration (apa) requires more advanced science knowledge to help you find a support program, though. Usually students earn one of the following schools when they attain a college diploma or equivalent : [substeps] High school diploma or equivalent.', \\\"To finish, you'll need to attend medical school. [substeps] Tuition for medical school might be a reasonable amount for someone who can take med school, but if it's more expensive, you'll probably need to continue advancing in order to make money.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}