{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"da6dc27a-16af-5f96-85b4-ed1927082f54","task_key":"default--validation--183","task_revision_id":"1","upstream_id":"183","short_description":"HellaSwag validation 183","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to solve two step algebraic equations [title] Write the problem. [step] The first step to solving a two step algebraic equation is just to write the problem so you can start to visualize the solution. Let's say we're working with the following problem:-4x + 7 = 15.\",\"endings\":\"[\\\"[substeps] The first step is to think of a problem as for dividing the solve by a solution. Let's say we were working with step-xy and solve the problem by division of = 2 + 8.\\\", '[title] Decide whether to use addition or subtraction to isolate the variable term. [step] The next step is to find a way to keep \\\"-4x \\\" on one side and to keep the constants (whole numbers) on the other side.', 'Subtract 10 from the normal number in the multiplication equation. [substeps] X = 17 the 10 is the 14.', 'The result is the result of a two step algebraic equation. Write the problem with a capital letter (e.g.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}