{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"058a2359-664f-52cb-8c76-5252c72be55c","task_key":"default--validation--412","task_revision_id":"1","upstream_id":"412","short_description":"HellaSwag validation 412","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to care for a senegal parrot [title] Choose a large cage. [step] Senegal parrots need roomy cages. The minimum size is 20 inches (50. 8 cm) long by 20 inches (50. 8 cm) deep by 28 inches (71.12 cm) high (for one parrot), but bigger is always better.\",\"endings\":\"['Due to their clever dispositions, pick an escape-proof one (though some senegal parrot owners may realize \\\" escape-proof \\\" isn\\\\'t necessarily true). [substeps] Bar spacing of ¾ inch (1.9 cm) is ideal.', \\\"What you don't have to worry about is the size of the space your bird can comfortably move around in. If you have two birds, consider making sure the space is large enough for each parrot.\\\", 'Senegal parrots are huge birds who cannot stand heights and require bigger cages. Not only are they more compact than average birds, but they also do not tolerate gravity well.', \\\"[title] Look at your parrot's enclosure. [step] Your senegal parrot needs an enclosure that is approximately 12 feet (1.2 m) by 14 feet (30.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}