{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"926925fe-ae2f-5c04-b461-cb77687a94fd","task_key":"default--validation--13310","task_revision_id":"1","upstream_id":"13310","short_description":"HellaSwag validation 13310","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to encourage a child's speech development [title] Get a physical assessment of the child. [step] This can rule out any potential health problems. Conditions that affect hearing or speech, itself, will obviously play a major role.\",\"endings\":\"[\\\"If you have concerns, however, get a physical assessment from your child's pediatrician. [substeps] You may want to consider the age and mental level of the child, as well as if they are likely to have an ability to effectively speak enunciatively and clearly.\\\", \\\"[title] Prepare a book list for your child. [step] Thinking about the pages of the child's book list can provide some good clues as to which book they would most like to read.\\\", '[title] Calm down! [step] A stressed out parent or caregiver and child will not help the situation. Understand that every child works at their own pace.', 'A physical assessment of the child can help ensure he can speak clearly in public. [title] Allow the child to speak as frequently as possible.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}