{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5cc5b7da-6ff0-55ca-8853-3b29858a6e0c","task_key":"default--validation--33087","task_revision_id":"1","upstream_id":"33087","short_description":"HellaSwag validation 33087","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to watch a dog for stiff or limp movements [title] Look for a limp gait. [step] A common sign of distress is a limp gait. Your dog may limp as they walk on their paws.\",\"endings\":\"[\\\"A limp might signal that your dog is in pain and having to walk around constantly. [substeps] Also, a dog's gait might be stiff and liquid-like.\\\", \\\"You may notice your dog's gait becomes stiff immediately and then wobbly, or the dog slides with reluctance or walks on wobbly legs. [substeps] A limping dog may have slowed down the pace of walking, or they may slump on the ground when walking and wither even more quickly.\\\", 'The dog may also hold up one of their legs. The limp movement may be in multiple legs, so the dog may walk on different legs at different points during the day.', 'This type of gait can indicate too much stress on the joints or reduce mobility or coordination. [substeps] If your dog has a limp and not much coordination or coordination, it may be referred to as limping.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}