{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"26868275-600f-55ce-beaf-07ab28c26785","task_key":"default--validation--40103","task_revision_id":"1","upstream_id":"40103","short_description":"HellaSwag validation 40103","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to stop slouching [title] Keep good form while sitting. [step] Your body has natural curves in it, and good posture helps promote that. To have good posture while you sit, you need to keep your shoulders back, your chest open, and your back straight and tall.\",\"endings\":\"['During the day, you should keep your back straight and stiff; you can do this by taking deep breaths and counting to three. If you are at work, look up at the sky.', 'To keep your shoulders back, you need to move your shoulders back and push your chest out more. You should feel your head move back as well.', \\\"[substeps] Think about using a desk chair to help balance your body. You don't want to look boxy, either, so use an accessory such as a belt or small purse to help balance your body and your posture when you sit.\\\", 'When sitting, your spine should be straight. [substeps] Try to get off the chair a little bit so that your shoulders are not off-center.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}