{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ab93ca3a-e0ec-5587-85f0-f0f06f308fa7","task_key":"default--validation--26289","task_revision_id":"1","upstream_id":"26289","short_description":"HellaSwag validation 26289","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to live with ehlers danlos classical type [title] Recognize the symptoms. [step] If you suffer from eds, classical type, you can expect to see the following. [substeps] Skin hyperextensibility.\",\"endings\":\"['This means the skin is very elastic, stretching very easily and then snapping back into place. The skin of someone with this condition is also often particularly smooth and velvety to the touch.', 'The skin can be smooth, smooth, soft or rough. The scales on your feet are narrow, but the skin can be smooth.', 'This range of symptoms shows up in most classical styles. Hands, feet, feet, your hands, legs, hands, knees, and feet are abnormal.', 'Acetylsalicylates affect one brain organ organ, causing the fluids to pool in the heart. Unfortunately, these are the main organ on which you heart beats the most frequently.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}