{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a1c679f4-bf79-5c1a-8b95-83bc8e08f0d5","task_key":"default--validation--30572","task_revision_id":"1","upstream_id":"30572","short_description":"HellaSwag validation 30572","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to teach practical life skills to your children [title] Teach your child to brush their teeth. [step] Purchase a toddler-sized toothbrush with soft bristles for gentle brushing. Initially, you can help your toddler brush their teeth, but you should still be responsible for the cleaning.\",\"endings\":\"[\\\"A small child won't be thorough. Most children are capable of brushing alone between the ages of 6 and 8.\\\", 'Use soft bristles as to minimize rubbing or breakage. [substeps] Be sure to use soft brushes, as toddlers can scratch their teeth with fingernail.', 'If you are teaching your child to brush their teeth, start by washing your hands before, during, and after brushing. [title] Encourage your toddler to wash their hands before and after brushing.', 'Provide your toddler with the toothbrush only during diaper-time. Whenever your toddler has to use the toothbrush, you should also treat the bristles with baby wipe to remove teeth if the bristles are dirty.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}