{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6b354ccd-5caa-518a-80ab-a5de9db57c32","task_key":"default--validation--31758","task_revision_id":"1","upstream_id":"31758","short_description":"HellaSwag validation 31758","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to teach your child to blow their nose [title] Teach your child the concept of blowing air intentionally. [step] Blowing air, whether through the mouth or the nose, is a learned skill. Unlike breathing regularly, blowing involves intention.\",\"endings\":\"['This is great exercise for children who are beginning to master the concept of blowing, as they can work on their learning later on. [substeps] To teach your child to blow, begin by taking one puff.', \\\"While you should notice your child breathing more deeply when they are blowing, if you notice that they do not be breathing at all, then there's a good chance that they are blowing in the wrong nostril. Learn to recognize the two hallmarks of blowing.\\\", 'If your child likes to imitate your actions, start by encouraging imitation when he is well. You should do the action first, and your child can imitate what you do.', \\\"Blowing (blowing out air toward another person's nose) forces the air out of the other person's mouth, causing him to blow his nose. However, the other person's nose narrows, which increases the amount of air needed to create another nostril.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}