{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d9ad8ce0-ea2c-590b-b1fd-1c9016c9cedf","task_key":"default--validation--34051","task_revision_id":"1","upstream_id":"34051","short_description":"HellaSwag validation 34051","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to teach your kids to have a work ethic [title] Give chores to every family member. [step] Assigning chores is one of the best ways to teach work ethic and responsible behavior. Chores should be age-appropriate and based on their interests and talents.\",\"endings\":\"['They should also be based on teamwork and love working as a team. If your kids have to do a lot of dishes, remember that even one dish may not go bad for a day or week.', 'Small chores like emptying the dishwasher, cleaning the bathroom or washing the dishes makes for a great work ethic. [substeps] Small chores include emptying the dishwasher or fixing the water filter.', \\\"[substeps] Chores should ben't simple chores like chopping up vegetables or cleaning the house. Chores should be tasks like feeding dogs, answering phones, or playing in the car.\\\", 'If your child likes being outdoors, assign them to work in the garden or rake leaves. If your child is interested in cooking, let them help you prepare dinner and wash the dishes.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}