{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"48bc1989-5e64-55a3-91a0-71efc146575b","task_key":"default--validation--40360","task_revision_id":"1","upstream_id":"40360","short_description":"HellaSwag validation 40360","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to help a cat with ataxia [title] Administer prescribed medications. [step] In order for your cat to recover, you'll need to be diligent in your treatment. You should give your cat its prescribed medications on time every day, and follow the medication instructions to the letter.\",\"endings\":\"['You can administer medication directly to the cat or directly before it goes to bed. [substeps] Spaying, neutering, and doing surgery rarely cause ataxia.', 'Having a full supply of medication available as a supplement will help it return to health and function. [substeps] If given the medication, you should administer a single dose, spaced within 30 minutes of each feeding.', \\\"[substeps] If your cat refuses to take its medicine (or if the symptoms of ataxia are already quite advanced), your cat may need to be hospitalized and treated by the veterinarian. This way, the vet can administer drugs and fluids intravenously, and monitor your cat's progress.\\\", \\\"You need to stay next to your vet so that they can provide you with reminder that it's their responsibility to give your cat the proper proper dosage. [substeps] You can offer your vet specific instructions if you give a medication to your cat.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}