{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"580b7502-072c-5705-a06a-a7f6bf07dc1e","task_key":"default--validation--17774","task_revision_id":"1","upstream_id":"17774","short_description":"HellaSwag validation 17774","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to prevent canine infectious hepatitis [title] Get your dog vaccinated. [step] The best way to prevent canine infectious hepatitis is to get your dog vaccinated against the disease. This vaccination can be done at the same time as a distemper vaccination, starting when a dog is 9 to 12 weeks old.\",\"endings\":\"['[substeps] Older dogs with an unknown vaccination status should be given the vaccine followed by a second one in 3-4 weeks. After the initial vaccines are done, it is common practice for a puppy or dog to get a yearly follow up vaccine to provide continuous protection.', 'It is painless and can be administered by your vet if necessary. [substeps] Hsv is not the same as hepatitis, and can be spread through saliva, sexual contact, or intravenous fluids.', \\\"However, if your dog's immune system is weaker, then it may be resistant to doing this vaccine. Vaccination typically takes place 30 to 60 days after a dog has had his shots, preventing the transmission of the virus.\\\", 'The cdc recommends that the average dog been vaccinated for canine hepatitis does not exceed 9 to 12 weeks and is highly contagious. The cdc recommends getting your dog screened for hepatitis every 6 months.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}