{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"aed5dbd4-666b-5e61-a404-655ff63ef843","task_key":"default--validation--3902","task_revision_id":"1","upstream_id":"3902","short_description":"HellaSwag validation 3902","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to diagnose canine coronavirus [title] Identify the symptoms of coronavirus. [step] Diarrhea is the common symptom, although this can occur for a variety of reasons. The diarrhea related to coronavirus is often very liquid with a foul smell, and yellow-orange in appearance.\",\"endings\":\"[\\\"To identify the cause of your dog's diarrhea, look for : [substeps] Yellowish diarrhea bleeding white stools difficulty moving [title] Prevent complications. [step] As doctors learn the actual symptoms of viral meningitis, they may decide to promote additional nutrition and reduce diarrhea.\\\", '[substeps] In severe cases of the diarrhea, the dog may regurgitate from its stomach or thus pass it on to another dog. This can happen as an infection or as a result of weakened immune systems.', 'This condition is usually produced by adult dogs only. [substeps] Diarrhea can take a long time to occur, and causes it to be hard for your pup to take in a proper diet.', 'The diarrhea is often accompanied by stomach cramps, which make the dog depressed and miserable, and its likely to lose interest in food. [substeps] Unlike with parvovirus, vomiting is rare.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}