{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c55a8d9e-7ad4-52db-a8cf-19464b053e8c","task_key":"default--validation--23380","task_revision_id":"1","upstream_id":"23380","short_description":"HellaSwag validation 23380","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to help your sixth grader succeed in math [title] Know what your 6th grader will be learning. [step] By knowing what your 6th grader will be learning in math class, you will be able to help your 6th grader get high grades on their homework and tests. Sixth graders learn a variety of math skills.\",\"endings\":\"[\\\"However, before you start teaching your third grader math skills, you will want to start step-by-step to help your toddler develop these skills. Identify your 6th grader's learning style.\\\", 'Take note of any developing differences between their ages. Some advanced classes may offer a sixth grader the opportunity to be a science geek or level-headed scientist.', 'You will need to learn the same concepts on a variety of test systems, though. Your classes will not teach much, so be prepared to stand in front of a mirror during a couple of test sessions.', 'Your sixth grader will learn how to : [substeps] Multiply and divide fractions. Understand ratios and rates, and solve word problems relating to ratios and rates.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}