{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4234eecb-9e64-5daf-9a70-9ad2af0f02c9","task_key":"default--validation--48847","task_revision_id":"1","upstream_id":"48847","short_description":"HellaSwag validation 48847","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to do yoga if you are overweight [title] Pick a style. [step] There are many yoga styles available to choose from. In the end, you'll need to pick a style that suits your personality, goals, and abilities.\",\"endings\":\"['You can find yoga videos online and at your local yoga studio. For a good case study, look for the following : [substeps] Beginner moves active moves low to medium reach arm, wrist, and elbow speed advanced moves appropriate for your purposes [title] Take a deep breath.', 'Popular yoga styles include \\\" rain rock \\\" for more unusual poses, \\\" leopard eye \\\" for more intense poses, and \\\" downhill cascade. \\\" [title] Figure out how often you spend time with your dog.', 'Consider : [substeps] A vigorous yoga style that will help you become more flexible and challenge your cardio abilities. For instance, try the kundalini style.', 'Some of the most popular poses include : [substeps] Sit or lie face down or shake your head to center movement. Keep your knees slightly bent with a mild twist to them as you stand.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}