{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3231c5fe-54a5-575c-a26a-a6f02fd652b2","task_key":"default--validation--44573","task_revision_id":"1","upstream_id":"44573","short_description":"HellaSwag validation 44573","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to use kaufman cards [title] Determine what the child's speech difficulties. [step] To begin working with the kaufman cards, you must know what kit level to use. That means understanding what vowels, consonants, and syllable shapes the child has already mastered.\",\"endings\":\"[\\\"The kaufman speech praxis test for children is often used to determine a child's level. [substeps] It's best to have a speech therapist administer the test to the child to ensure that the results are accurate.\\\", '[substeps] If the child struggles with identifying sounds, or has a hard time understanding terms under \\\" active voice, \\\" say \\\" active voice \\\" followed by a + or a b in between the letters. [title] Find out about the child\\\\'s vocabulary.', 'How you use the cards determines which steps you take when you order the cards online, in person, and in the store. [substeps] Some online cards may offer more basic food cues, with half of it understood and the other half almost exclusively included in the kit.', '[substeps] If the child cannot speak, ask questions like, \\\" what is it that is causing the straining? \\\" or \\\" what does this sound like? \\\" read through the cards aloud to see which words are used in speech. Note the correct pronunciation for the child\\\\'s native languages, and add to the description as needed.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}