{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"85dbd401-97ee-51d7-8755-de8a723770b0","task_key":"default--validation--46412","task_revision_id":"1","upstream_id":"46412","short_description":"HellaSwag validation 46412","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to be healthier in 14 days [title] Ditch your car. [step] This can be tricky depending on where you live, but spending less time in the car and more time on foot will help you lose weight, decrease stress, and elevate mood. If you have the option, walk to work or the grocery store instead of driving.\",\"endings\":\"[\\\"If you can't drive, stay in your car as you would at home. [substeps] Remember to carry a lunch bag with you wherever you go.\\\", \\\"[substeps] If you do go to work, still stay healthy. It's okay to go for a jog on the trails in these days.\\\", 'Otherwise, carve out thirty minutes a day to go for a walk. [substeps] Call up a friend to go walking with you.', \\\"Do at least one full day of exercise per week, but try to stay within some physical limits. [substeps] Don't smoke, drink alcohol, or use other prohibited substances.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}