{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4c580f2b-5002-5e8f-aa64-8ed743d01d13","task_key":"default--validation--44384","task_revision_id":"1","upstream_id":"44384","short_description":"HellaSwag validation 44384","config":"default","split":"validation","body":"{\"activity_label\":\"Sports and Fitness\",\"ctx\":\"[header] How to walk to lose weight [title] Walk with correct form. [step] Like most exercises, there's correct form to walking. Even though it's a low-intensity exercise, if you have incorrect form, you may increase your risk of soreness and injury.\",\"endings\":\"[\\\"Walking lightly and without causing injury, you'll still make strides. This applies to walks as well as other forms of exercise.\\\", \\\"[substeps] When you're walking, keep your shoulders back, down and relaxed. Your head should be up and facing straight ahead.\\\", \\\"Try not to cross your feet or skip steps. See your doctor to make sure that you're properly fitting for a high-intensity activity.\\\", \\\"Therefore, if you're unsure of your form at all times, find a cardio or strength training program that works for you. [substeps] For a low-intensity cardio program, schedule an alternate workout every time you make the same circuit.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}