{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7fa96a6d-d0b3-5993-bb22-3815d1c59356","task_key":"default--validation--15207","task_revision_id":"1","upstream_id":"15207","short_description":"HellaSwag validation 15207","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to care for havanese dogs [title] Choose a food that is meant for small breeds. [step] It is important to choose a dog food that will meet the nutritional needs of your pet, so make sure that the food you choose is of high quality. You should also choose a food that is meant for small breed dogs.\",\"endings\":\"[\\\"Due to the high quality, it is easy to confuse food forage and diet requirements. Prices will vary depending on your pet's age and level of activity level.\\\", \\\"You should also make sure that the food you choose is based on your dog's weight. Overweight dog food will make your dog lethargic, which is a problem in small breed dogs.\\\", \\\"Regular dog food pieces may be too large for your havanese to chew, while food meant for small dogs comes in smaller pieces. [substeps] If you can't decide on what to feed your havanese, then check with your havanese's breeder or veterinarian.\\\", '[substeps] The drier the food, the more calories it will provide your dog. Smaller breeds such as a basset hound or a croneclus can require smaller dog food.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}