{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bbcb6ce1-1045-5b71-894e-9d383a196fa7","task_key":"default--validation--29385","task_revision_id":"1","upstream_id":"29385","short_description":"HellaSwag validation 29385","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to track developmental milestones for older children [title] See them lose their first tooth. [step] A child's full set of baby teeth have usually formed by age 3. As your child gets older, one of the big milestones is to see them lose their baby teeth, and start to form adult teeth.\",\"endings\":\"['This is a common reason why children first wear braces. In doing so, they make their teeth look smaller.', \\\"This isn't painful for your child, and even when babies do lose their teeth, it is a novel experience for them to learn about how teeth work. Showing your child both beautiful and desirable teeth helps them to see their first teeth emerge, and it also keeps them from feeling embarrassed.\\\", '[substeps] Some kids lose their first tooth as early as 4, or as late as 7. But most kids start to lose their teeth around age 6 or 7.', \\\"This is challenging and takes a lot of patience and preparation. [substeps] Continuing to develop your child's teeth is also quite challenging because of the effort involved in letting them grow.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}