{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8df569fa-4493-5c3c-b604-de45cf1663d6","task_key":"default--validation--7142","task_revision_id":"1","upstream_id":"7142","short_description":"HellaSwag validation 7142","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to take your child to the dentist [title] Make your child's first appointment. [step] Your child should first see the dentist either when their first tooth appears or by the time they turn one. This visit is meant mostly to talk with parents and help your child get accustomed to the dentist's chair.\",\"endings\":\"['If they show the early signs of tooth decay or suffer from existing teeth, you should have your child visit once a day during appointments. [substeps] Some children smile when they see their dentist, despite their teeth being crooked.', \\\"Ask your dentist where they are and whether your child has a scheduled appointment with the dentist. [substeps] Most people over the age of three can visit the dentist either at their home, a family office, or in a friend's house.\\\", \\\"Your child should be in the dentist's chair for up to one year, although this may decrease up to three years. [title] Understand that brushing your child's teeth every day is one of the best ways to prevent gingivitis.\\\", '[title] Determine when your child must return for their next visit. [step] Ask your the dentist about when the next appointment should be.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}