{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3fa92af6-1e1c-59de-af33-10bd45b0401b","task_key":"default--validation--40168","task_revision_id":"1","upstream_id":"40168","short_description":"HellaSwag validation 40168","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to manage cognitive dysfunction in senior dogs [title] Give your dog medication. [step] There is one medication that veterinarians use to treat cognitive dysfunction. This medication is called deprenyl (anipryl), and it has been shown to help with symptoms and increase brain concentration in dogs.\",\"endings\":\"['[substeps] Deprenyl includes anti-anxiety drugs. You can take two to three simple doses daily and your dog will start feeling less anxious and irritable within one to two weeks of having any medication taken.', '[substeps] However, it does not work with all dogs. Some dogs will see no to minimal improvement.', 'Most dogs will be able to take this medication for 60 minutes at a time without worsening symptoms. [substeps] Deprenyl is very difficult to manage for an adult dog.', 'Your dog can use this medication alone, or with its friends and family. [substeps] Probenbenectate (napec) is another medication used to treat cognitive dysfunction but it does not work for older dogs.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}