{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"988f5152-6b89-5b10-bf28-18c9d04fbde0","task_key":"default--validation--46551","task_revision_id":"1","upstream_id":"46551","short_description":"HellaSwag validation 46551","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to become a better kickboxer [title] Start slowly. [step] Once you are ready to graduate from training on your own to practicing with real live partners, resist the urge to treat sparring sessions as actual matches. Instead, utilize these sessions as what they are: practice.\",\"endings\":\"['Figure out whether you are able to spar effectively on your own. If you are due to an injury or longer distance between you and your opponent, do not pick up a partner or alternate switching you situations.', 'Begin sparring at a pace and volume that suits your abilities at the current moment, rather than launching into an all-out bout right from the get-go. [substeps] As an upcoming match draws near, increase the intensity to match-level during the week leading up to it to prepare yourself for an actual fight.', \\\"Practice your first kick, then simply move on to a more controlled and controlled attack and try to catch in the instructor's stance. Better yet, further challenge your instructor by learning to throw the punch for your first email versus following their lead.\\\", '[substeps] Learn to distinguish between fighting with your hands and punching, like regular boxing and boxing, versus using your correct hand weights. Practicing is also a great way to prove your skills.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}