{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"46e63f80-925a-5717-88f7-8e21b02498bc","task_key":"default--validation--19967","task_revision_id":"1","upstream_id":"19967","short_description":"HellaSwag validation 19967","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to prevent ascarids in dogs [title] Find the proper deworming medication for your dog. [step] Feel free to ask your vet for suggestions. There are a huge number of effective worming products available on the market.\",\"endings\":\"['Key to worming success is checking the package to see exactly which parasites the product is effective against. You are looking for effectiveness against ascarids species, including toxocara and toxascaris.', '[substeps] Over the counter deworming treatments alone are not likely to reduce the symptoms of ascarids in dogs. If you have tried other types of methods for treating these various ailments, you should try serious or potentially dangerous treatment options first.', 'In order to make sure that your dog is getting enough pain relief, you might ask your vet for recommendations. Stay within the recommended dosage as most medications are specially formulated for dogs.', 'The best advice will come from a vet who can specifically recommend an appropriate medication for your dog. [substeps] You also might want to visit your veterinarian for recommendations on the correct dosages.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}