{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c635f4a8-366d-5c5c-9ea4-056d26420239","task_key":"default--validation--43140","task_revision_id":"1","upstream_id":"43140","short_description":"HellaSwag validation 43140","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to co parent with an uncooperative ex spouse [title] Discuss time arrangements. [step] If the court has not mandated your time arrangements, you need to have a discussion about them. You can't just leave the arrangement vague and expect it to work well.\",\"endings\":\"['It\\\\'s important to have a discussion about how the transition will affect the children and/or the work or professional life of both parties. [substeps] You also shouldn\\\\'t let the court rule \\\" no \\\" even if your child wants to turn around and graduate with you.', \\\"Bring up how the separation will affect the intended child's future. [substeps] Set out deadlines and define when the child will get the benefits that they are seeking.\\\", \\\"If you don't think you can decide on one alone, consider talking with a counselor to help work it out. [substeps] You need to discuss what nights the child will be spending with which parent, who's responsible for what activities, and who's responsible for which care-taking activities.\\\", 'Take your time and consider finding alternatives, even when you are in a time crunch. If your parents have not provided adequate time to consult with you on the matter, its important that you have time to talk about the matter.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}