{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b8391716-e4fc-5171-a9be-8e4efb84fd0a","task_key":"default--validation--32536","task_revision_id":"1","upstream_id":"32536","short_description":"HellaSwag validation 32536","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to measure mass [title] Know that f (force) = m (mass) * a (acceleration). [step] This simple equation is what you'll use to convert weight into mass (or mass into weight, if you want to). Don't be worried about what the letters mean-we'll tell you : [substeps] Force is the same thing as weight.\",\"endings\":\"['Co (force) is the same thing as mass. N (force) is another thing to consider.', 'We convert this to mass with the same exponent in pounds. [title] Measure weight in ounces before eating junk food.', 'We will stand in a crowded elevator and say to ourselves \\\" m (force) + u * u. r = r (( acceleration) + u \\\"] or \\\" l \\\" again if you want to math and multiply mass by mass.', \\\"Use newtons (n) as weight. Mass is what you're solving for, so it may not be defined to begin with.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}