{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"af6a45fe-4b94-5ca6-8abd-62e54a977a6f","task_key":"default--validation--26543","task_revision_id":"1","upstream_id":"26543","short_description":"HellaSwag validation 26543","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to introduce your child to sippy cups [title] Introduce the sippy cup at the right time. [step] You want to make sure you don't introduce the sippy cup before your child has the motor skills to handle it. Introducing the sippy cup at the right time will help with a smooth transition.\",\"endings\":\"[\\\"Typically, you want to introduce the sippy cup at the right time for your child to start handling the plastic cup. [substeps] For example, you could introduce the sippy cup to your child ten minutes before it's time to go to the bathroom.\\\", '[substeps] For the most part, doctors recommend starting the sippy cup around 6 months old. At this point, your baby will be old enough to manage the cup.', \\\"[substeps] Slowly introduce the sippy cup into your child's reach until it is too small for her to grip it. While still encouraging her to hold it in place, work your way back to the last step.\\\", \\\"[substeps] Early on in the training process your child will be aware of what they're drinking when they open the cup. Then they'll start to realize the impact sippy cups have on their motor skills and motor skills.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}