{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a0da5306-70ea-5c33-8bb7-dd0cbe236700","task_key":"default--validation--10236","task_revision_id":"1","upstream_id":"10236","short_description":"HellaSwag validation 10236","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to deal with a teenage son [title] Make your expectations clear. [step] Your teen is less likely to push back if he has a voice in some of the rules. Sit down and have a talk with him about what each of you think is fair in terms of rules and consequences for breaking them.\",\"endings\":\"['Post these rules in a common area so that they can be accessed easily. [substeps] The consequences should be appropriate for the rule that was broken.', \\\"Agree on what the rules are so that he doesn't fall in line with some of the consequences. [substeps] Figure out your son's boundaries with a fair understanding of what does and doesn't matter.\\\", \\\"[substeps] Establish specific consequences for breaking certain rules. For example, start by asking your teen how much privileges he'll get when he's home.\\\", \\\"[substeps] For example, don't lead a teenager into doing something he won't enjoy, no matter how much his parents may say that it would help him better cope with school. Many teens are insecure about parental control, especially when things in a relationship revolve around expectations.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}