{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f6815ef0-d4dd-5c10-943c-c6a5177285aa","task_key":"default--validation--49865","task_revision_id":"1","upstream_id":"49865","short_description":"HellaSwag validation 49865","config":"default","split":"validation","body":"{\"activity_label\":\"Sports and Fitness\",\"ctx\":\"[header] How to shadow box for fun and exercise [title] Get in the correct stance and punch slowly for 1 minute. [step] You can use any punch you like for this warm-up. Flex your arm muscles and make the movements as slow and deliberate as possible.\",\"endings\":\"['It makes it easier to get into the correct stance and do the right punch. [title] When the energy is at its fullest, pop out of your body.', \\\"Your arm muscles should not stretch while you are in this position. Let your left arm do the work and don't let yourself get tired of the movements.\\\", 'When you are confident that you are ready to speed up, then you can begin to move faster. [substeps] Switch which leg you lead with half way through your work out so you strengthen both sides of your body equally.', 'Target the muscles near your shoulders and forearms. Also keep your arms open with your hands out.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}