{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e283400c-c733-527e-9e9b-4b401802f562","task_key":"default--validation--31142","task_revision_id":"1","upstream_id":"31142","short_description":"HellaSwag validation 31142","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to set up a dressage arena [title] Make sure your space is the right size. [step] Before you set up the arena, you will need to make sure that you have a big enough place for the arena. A standard dressage arena is 20 meters by 60 meters (or about 66 feet by 197 feet).\",\"endings\":\"['A horse arena is 30 meter by 35 meters or about 53 feet. It has 25 meter all male stalls and 25 meter by 3 meters.', 'You will be practicing out of a small arena, so you will want a medium sized arena. The arena must have enough space to accommodate at least 3 horses.', 'A short dressage arena is 20 meters by 40 meters (or about 66 feet by 132 feet). Find a space where you will have 1-2 meters (about 3 to 6 feet) of buffer around the outside of the arena.', 'It should have as many types of stalls as it can around it. It is important to have enough space for the horse to stand, with plenty of clearance between tables, benches, and stakes.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}