{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7c9404bf-1d68-518d-af12-d7b756deb454","task_key":"default--validation--21826","task_revision_id":"1","upstream_id":"21826","short_description":"HellaSwag validation 21826","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to care for disabled rabbits [title] Take your rabbit to your veterinarian. [step] Caring for a disabled rabbit is a major commitment and involves major changes to your routine. It might be overwhelming to think about what adjustments you will need to make to care for your disabled rabbit.\",\"endings\":\"['A qualified veterinarian or happy home care worker will be able to work with you to establish a budget and help you make the changes that you want to make. Even vets or happy homes often require veterinary treatment to ensure proper care.', \\\"Taking him to your veterinarian will give you a better understanding of your rabbit's disabilities and help you learn how to manage the disabilities at home. [substeps] Causes of disability in rabbits include injury, arthritis, and genetic deformities.\\\", 'However, the important thing is that you understand that domesticated rabbits need outdoor care to live comfortably. [substeps] Rabbits require at least six hours of supervised outdoor playtime each week, depending on their weight and activity level.', 'To help them make healthy changes, bring your rabbit in for a checkup two or three times a week, as well as every other day. [substeps] Beyond all, ensuring that your rabbit is comfortable and looking healthy will allow you to make the most of the long hours in your home and at the zoo.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}