{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9574ea2e-2f4b-50ab-8139-0d7ca440467d","task_key":"default--validation--15417","task_revision_id":"1","upstream_id":"15417","short_description":"HellaSwag validation 15417","config":"default","split":"validation","body":"{\"activity_label\":\"Sports and Fitness\",\"ctx\":\"[header] How to prevent swelling in hot weather [title] Stay active. [step] You don't have to perform rigorous exercises in the heat in order to benefit from them. Walking is a great way to prevent swelling because it gives you enough cardio to get your blood flowing.\",\"endings\":\"['This consistent blood flow is what will prevent your body from swelling. 30 minutes of walking daily is a good amount to start with to avoid swelling.', \\\"[substeps] When you're exercising, make sure to walk for at least one minute every two hours or so. You'll be more likely to experience any swelling while exercising.\\\", 'It will also release endorphins, which will also help repair the lesions that have formed. [substeps] Try to exercise the most in the summer.', 'It also helps to strengthen your spine because it makes it easier to continue walking. [substeps] If you want to strengthen your spine, bring two to three weeks of walking a week.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}