{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f1387dd8-c039-555e-ba56-f67a68a76df3","task_key":"default--validation--33677","task_revision_id":"1","upstream_id":"33677","short_description":"HellaSwag validation 33677","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to teach your child not to hit others [title] Consider normal child development. [step] Babies naturally explore the world through biting and hitting things around them. Hands and teeth are a child's first social tools.\",\"endings\":\"['Also, as babies begin to learn to defend themselves against physical attacks and misbehavior, they need to rely on safe behaviors. Make sure that your child watches you and makes signs that they are becoming proficient with biting and hitting.', 'Many kids will have these 3d toys despite their age, but they are probably just a little older and only need to learn a little bit about the world. Always, tell your child this bedtime is only for them.', 'A child learns to use them to explore the things around them as well as the reactions she gets from others when she uses them. [substeps] Biting and hitting is most common between the ages of 18 months and 2 1/2 years, while language is still developing.', \\\"Children learn how to express their emotions when they don't like a lot of the too-abrupt situations. Children who make rough decisions about the world can benefit from learning how to react to situations as well.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}