{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8d115a0c-93a5-5838-85eb-12626694f620","task_key":"default--validation--40506","task_revision_id":"1","upstream_id":"40506","short_description":"HellaSwag validation 40506","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to encourage healthy interactive screentime for kids [title] Be mindful of choosing the right media for young children. [step] Even when a movie or tv show is characterized as \\\" educational, \\\" parents still should be cautious. Too much screen time can still be a detriment to your child's development, particularly in very young children.\",\"endings\":\"[\\\"Poor video interactive screentime can contribute to your child's favorite snacks and entertainment. Some examples of no-media programming are becoming increasingly more and more disinterested in your child's storyboard choices, and even playing video games, icons, or other apps.\\\", '[substeps] If you are selecting screen time choices for toddlers, lean towards those with an interactive element in which the child is being shown some visual or audio aspects, being given instructions, and then asked to do something as a result. [title] Use screen-time to teach older kids lessons.', 'Find a young picture educational program that requires the right subjects for your child, as these options can be difficult for a children. [substeps] Families who are interested in their children can do more than simply be nice to their children because their desire to be interesting has motivated them from childhood.', \\\"[substeps] Don't turn tv into a habit. Many children find it comforting to watch a television program and work for large companies.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}