{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b7a89853-de57-5e9a-b23f-f4567a69071b","task_key":"default--validation--40667","task_revision_id":"1","upstream_id":"40667","short_description":"HellaSwag validation 40667","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to teach a child the value of money [title] Teach your child the importance of waiting. [step] Good spending habits are rooted in the ability to delay gratification. You wait for a month, for example, to buy a computer program you've been eyeing.\",\"endings\":\"['Children begin to comprehend the concept of waiting between ages 3 and 5. This provides you with the opportunity to teach them about how waiting factors in to saving and spending.', \\\"Do you wait longer than another month before your child eats? It's a specific type of dependent that discourages eating habits (adults). In high school, for example, students and adults begin to hide money from their parents.\\\", \\\"That month after the dates of buying a computer program, you'll pick up several thousands of dollars on the new ios device. [substeps] Choose the system that works for you.\\\", \\\"When you find yourself unable to wait for a few minutes, it means something may have gone wrong. Eventually, you'll either have to wait for an hour for one day, or a day for a week and a half.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}