{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2c870892-732e-58c1-ac86-286a66a4054b","task_key":"default--validation--3795","task_revision_id":"1","upstream_id":"3795","short_description":"HellaSwag validation 3795","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to get better grades in elementary school [title] Find out how your grade is determined. [step] One of the most important things you can learn at the start of the school year is where your grade comes from. This means asking what assignments get a grade, and how much each one is worth.\",\"endings\":\"['There are a number of ways you can find out if you have multiple grades, which is a bigger important thing to know as elementary school ages come closer to graduation and your final grade. This way, if you find out you have a different grade, you can identify the issue that needs to be addressed.', 'Take a moment to think about how getting good grades will make your reading and math level balanced. [substeps] You might want to talk to some of your teachers to find out how many times they switch students or if they can change students for homework assignments.', \\\"If you have all math and science skills (science likely), and if your grades are similar to someone else's, you might be able to get a better grade. [substeps] Some teachers are concerned that students with poor grades get annoyed and complaining about the times they cannot get 3% on one assignment.\\\", 'This will let you know the really important assignments, as well as the things you need to do to help improve them. Your teacher probably gave you some of this information at the beginning of the school year, but it can always help to ask.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}