{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2ff5e184-fcec-5f31-8cc6-1d4451975e25","task_key":"default--validation--42072","task_revision_id":"1","upstream_id":"42072","short_description":"HellaSwag validation 42072","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to prevent a child from biting [title] Create and enforce guidelines for children when playing with other children. [substeps] Clear and precise explanations of how to interact with others and monitoring will decrease situations that result in biting. Discuss and give examples of sharing, taking turns and respecting space.\",\"endings\":\"['Monitor and correct children not following the guidelines as needed. [title] Observe the child closely when he or she is socializing with others.', 'Express your feelings to the kids as well. Have them explain how feeding, playtime, and sharing their favorite food are perfectly normal and appropriate for their age.', 'Include rule when working together with two children. This will minimize conflict and collaboration and help prevent biting.', \\\"Vary the tasks we perform when eating or playing with other children from adult checking and monitoring to help each child understand their limits. Don't establish conflict between your children and adults while they are playing with other children.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}