{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bc637789-b489-54b9-bcca-d8fb48fe4a0f","task_key":"default--validation--11391","task_revision_id":"1","upstream_id":"11391","short_description":"HellaSwag validation 11391","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to improve leg circulation [title] Don't sit or stand for too long. [step] It's important to move around during the day to get the blood flowing through your legs. Sitting or standing for long periods of time allows the blood to collect instead of flowing, and is detrimental to your health over time.\",\"endings\":\"[\\\"[substeps] During your daily activity, stand or bend your legs to give yourself a break from stress or you can use crutches for the bulk of the duration of the exercise. If you find that sitting for long periods of time doesn't work out well for you, try switching to a standing pose.\\\", 'Sitting for extended periods can cause ankle injuries and balance problems. [substeps] Have a good posture so that your back is straight and your hips are tilted in slightly.', \\\"If you find you've been in the same position for an hour or more, move around for a few minutes before resuming your position. [substeps] If you work in an office and are required to sit for your job, get up and take breaks every hour and a half or so.\\\", '[substeps] Avoid all outdoor activities such as soccer or indoor sports like hiking, ice skating, and croquet. Getting more blood circulation will enable your blood to circulate and help your body function more efficiently.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}