{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fe2e95a3-9d80-58de-b6f0-376c9f5b2c3d","task_key":"default--validation--31249","task_revision_id":"1","upstream_id":"31249","short_description":"HellaSwag validation 31249","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to prevent baby bottle tooth decay [title] Take your baby to the dentist. [step] The american academy of pediatric dentistry and the american dental association recommend that a baby get her first visit to the dentist after the first tooth emerges, no later than her first birthday. The dentist will check for signs of tooth decay or other oral problems.\",\"endings\":\"['[substeps] The dentist will also perform a dental history and give specific recommendations for baby tooth health. At this point, the dentist can start to begin to examine the tooth.', \\\"[substeps] Additionally, the dentist can teach you how to better care for your baby's teeth. Try to take your child to the dentist every six months.\\\", \\\"If necessary, the dentist may recommend that you continue to work with your baby for a month. [title] Follow the schedule listed for your baby's first visit.\\\", \\\"[title] Ask your dentist about your baby's dental needs. [step] All tooth decay is resolved with visits to the dentist.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}