{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b3353986-96de-5e46-83c7-259be8ea3c2d","task_key":"default--validation--16458","task_revision_id":"1","upstream_id":"16458","short_description":"HellaSwag validation 16458","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to make shared custody work [title] Put the child first. [step] In a shared custody arrangement, a legal plan is created to determine parental rights and responsibilities. When creating the plan, write down all of the child's activities.\",\"endings\":\"['This will help you establish rules between the two of you that will prevent the other parent from taking away rights. [substeps] Think about the information important to you before deciding who gets what.', 'Make sure they include their birthday, date of birth, school activities, church activities, and other important family details. Keep a record of these activities so that you can reference them as milestones.', \\\"Agree where the child will choose to live and how they will be raised. Some plans may allow you to handle all of the child's things, but others will require individualized or supervised childcare.\\\", \\\"Then, figure out which parent is best prepared to stick to the routine. Specifically, focus on what would work best for : [substeps] Your children's ages, temperaments, and emotional needs.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}