{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2e866688-f972-5b17-a8b8-5b4794158377","task_key":"default--validation--44987","task_revision_id":"1","upstream_id":"44987","short_description":"HellaSwag validation 44987","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to diagnose spondylosis deformans in boxers [title] Pay attention to stiffness in your dog. [step] Is your dog less agile than is used to be? If your dog has a less mobility and is reluctant to move, it may be due to this disease. This is because the spine has become fused with bone, making the dog more stiff and less flexible than it was in earlier life.\",\"endings\":\"['This is also because muscle strain is brought on by arthritis and develops at a faster rate, which means that parts of the spine get loose and reduce mobility. [substeps] Look for impaired coordination in your dog.', '[title] Pay attention to ways your dog moves. [step] Sometimes, dogs twist in the opposite direction than they are used to.', \\\"[title] Notice a difference in your dog's posture. [step] Your dog may have stiffness that causes it to slump forward, making its jaw and back muscles become stiffer.\\\", '[substeps] Happily, it rarely produces symptoms other than stiffness and is most often detected when the dog is x-rayed for another reason. [title] Look for the symptoms in older dogs.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}