{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bc1f2488-f736-587a-8bc6-2f1afb980b00","task_key":"default--validation--50285","task_revision_id":"1","upstream_id":"50285","short_description":"HellaSwag validation 50285","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to identify a hoof abscess in horses [title] Observe if your horse can put weight on the affected hoof. [step] Hoof abscesses occur when bacteria get trapped in the hoof. Pus then builds up, which increases pressure in the hoof because there isn't much room for the hoof to swell.\",\"endings\":\"['This pressure becomes extremely painful to a horse, causing it to become lame. If your horse has a hoof abscess, it may not be able to put any weight on the affected hoof.', 'They can appear as flat, elongated patches on the cow. The enlargement is usually the result of mother or foal hoof damage.', 'This is why other small animals can instead put weight on an affected hoof. [title] Determine if the horse is not moving much.', 'The swelling or swelling is not caused by this bacteria, but by a more subtle abscess, and it can interfere with the bandage should you ever see it. [substeps] It is best to refrain from closely examining the hoof for abscess site.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}