{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2aa1b7c3-3879-5848-88da-b663e894d873","task_key":"default--validation--20021","task_revision_id":"1","upstream_id":"20021","short_description":"HellaSwag validation 20021","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to prevent child molestation [title] Teach your children safety basics first. [step] This means covering not only the way to safely cross the street and watch for oncoming traffic but also role-playing situations that mimic the types of things would-be predators might do or say to get a child's attention. Try to tailor this activity to the age and maturity level of your child.\",\"endings\":\"['[substeps] Allow him to develop basic safety skills. Encourage your child to do so out of the comfort of his own home.', 'You can teach them the dangers of falling, that can cost them their life, and how to walk safely on sidewalks. [substeps] Use books and packages to explain safety skills.', 'Some ideas are : [substeps] Identify the traffic or safety hazards that your child is experiencing within a given intersection. Identify the hazards that your child may be facing.', 'You can even use dolls or other toys to make this less intimidating for your child. [title] Select an age-appropriate book and teach your child the parts of the body.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}