{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fedcaa95-e2e7-55c8-96fe-445f214bd0c2","task_key":"default--validation--12516","task_revision_id":"1","upstream_id":"12516","short_description":"HellaSwag validation 12516","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to treat epilepsy in beagles [title] Take your dog to the vet. [step] Your vet will do some testing to rule out other possible causes for the seizures. If no cause for the beagle's seizures is identifiable, the dog is assumed to have epilepsy.\",\"endings\":\"['[substeps] The veterinarian may want to test for poisoning, liver disease, diabetes, kidney disease, and anemia, among other health issues. At this point, treatment depends on the use of anticonvulsant drugs to suppress abnormal electrical activity in the brain, rather than treating the underlying cause.', \\\"However, even with ongoing testing, vets are still not ruling out the possibility that something could be wrong with your dog. [substeps] Urine can affect a dog's eating habits.\\\", 'Your vet may perform the following tests : [substeps] Blood test. The vet may check for tumors on the animal, such as scales.', '[substeps] If the vet makes a diagnosis, then they will refer your pup to a canine behavioral specialist for further treatment. [title] Lie down in a comfortable position so that the dog can see you and change direction.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}