{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a2751ace-6e13-5866-9a1d-caa2c7dabc98","task_key":"default--validation--50235","task_revision_id":"1","upstream_id":"50235","short_description":"HellaSwag validation 50235","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to avoid overindulging during the holidays [title] Give yourself healthy limits. [step] It's not realistic to completely avoid indulging during the holidays. The holidays are a special time and you deserve to loosen up restrictions regarding food once in awhile.\",\"endings\":\"[\\\"Instead of deciding you won't partake at all, set a series of healthy, realistic limits for yourself. [substeps] Try to set daily or weekly limits.\\\", 'Setting a limit may even help you treat yourself when you are overindulging. [substeps] You can eat much healthier foods during the holidays.', \\\"Before you indulge, make sure you're vegetarian and eat some healthy meals several days a week. Avoid incorporating binge feeding into your diet, due to its adverse side effects.\\\", \\\"If you set unreasonable expectations on yourself to allow yourself to indulge, you may find you end up overindulging. [substeps] For example, don't let your relatives force you to buy frozen dinners.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}