{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6477b587-333e-5017-bc05-d1f0866f123d","task_key":"default--validation--26816","task_revision_id":"1","upstream_id":"26816","short_description":"HellaSwag validation 26816","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to treat gastric torsion and bloat in labrador retrievers [title] Take your dog to a veterinarian. [step] There is no home remedy or medication that you can give to a dog suffering to bloat. The treatment is surgical, to decompress and reposition the stomach.\",\"endings\":\"['For this procedure, time is of the essence. Because of this, if you suspect bloat, take your dog to the vet immediately.', 'It involves having half a piece of meat slide from the gut to an applicator tube, and then draining bodily fluids through it. During the process, toxins oxidize and enter the rectum.', 'The vet then prescribes acetaminophen if the bloat is present in the dog. You can locate a vet at your local pet store or online.', 'The patient then then urinates, drinks water, and/or walks or jumps. You then must gently calm the dog down by rocking him or her back and forth.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}