{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"65d47fb4-e3cc-51ec-afc6-c8c0b38a35fb","task_key":"default--validation--8091","task_revision_id":"1","upstream_id":"8091","short_description":"HellaSwag validation 8091","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to help your child appreciate art [title] Visit museums. [step] Take advantage of your local museums-they're a great resource for getting your child interested in art! Many museums have children's sections designed to be accessible, engaging and fun. Kids often receive free or reduced admission.\",\"endings\":\"[\\\"[substeps] Museums are a great resource for young people with learning disabilities. They're not just a great source of outdoor entertainment, they are also incredibly accessible.\\\", '[substeps] Take advantage of community galleries as well as many ones that have kids. See what you are looking for! Museums will be glad to provide an affordable space for you to show your child so they can see firsthand the wonders.', 'Go see a wide variety of exhibits and try out some of the \\\" walk of \\\\'em \\\" exhibits. [title] Emphasize the ways art has artistic value.', \\\"[substeps] Before you go to the museum, look online for pictures and videos of the artwork you'll be seeing. Show your kids before you go so they know what kind of art to expect.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}