{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3b8de622-b904-56c4-a19b-9e3bf073ef11","task_key":"default--validation--16166","task_revision_id":"1","upstream_id":"16166","short_description":"HellaSwag validation 16166","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to deal with a child not wanting to go to school [title] Track how often they resist school. [step] There are some times that it's common for students not to want to go to school. They may feel that something happening outside of school is more appealing.\",\"endings\":\"['If the child is very close up with their teachers, see if they respond favorably to their behavior. [substeps] Sometimes the child may respond badly about school until parents explain the problem a few times.', \\\"Or, they may have a specific, but temporary, reason for not wanting to go. In other situations, it seems that there's no specific reason the child doesn't want to go to school.\\\", 'High school kids may resist school if they think this day is safer at school. [substeps] Try to figure out if you child enjoys going to school and he does not love high school.', \\\"Sometimes parents will also whine that school won't be good enough, when in reality the intention is to make things better. This can cause emotions to go awry.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}