{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9c3c77f8-2bb6-50fc-b9bc-14a0813f0d72","task_key":"default--validation--27248","task_revision_id":"1","upstream_id":"27248","short_description":"HellaSwag validation 27248","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to take care of a japanese bobtail [title] Take your cat to the vet. [step] When you first get your cat, take it to the vet, especially if it's a kitten. Bring any medical information and documentation provided by the breeder or previous owner.\",\"endings\":\"[\\\"Your vet will evaluate your cat's health and arrange a schedule with you to ensure it receives regular checkups. [substeps] Kittens should receive their first vaccinations at six or seven weeks of age, then again at ten, twelve, thirteen, sixteen, and nineteen weeks.\\\", \\\"[substeps] If the breeder or owner was critical about the cat, ask them if they have any qualified sick animals they'd like you to train in english. This will allow you to introduce the animal to a new carrier, even if the breeder or owner doesn't have certification that japanese bobtail is full of sick animals.\\\", \\\"See if your cousin or relative has seen or done tours of the neighborhood or neighborhood where your cat lives. Ask if your landlord's tenants and pets have noticed the cat.\\\", \\\"This might include detailed medical history, billing information, or prior vet visits. You will also need to decide if you want to have your cat's older cat make a lifestyle change (like the tail) or provide a special food.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}