{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c3063388-39c5-53a7-82c6-ab258081ecd0","task_key":"default--validation--30664","task_revision_id":"1","upstream_id":"30664","short_description":"HellaSwag validation 30664","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to deal with a controlling spouse [title] Stay calm. [step] For many people, arguing is a natural response to a spouse's controlling behavior. Unfortunately, a controlling person is unlikely to submit and let you win the argument, so this tactic will likely only escalate the situation.\",\"endings\":\"['Instead, stay calm and find ways to resolve your conflict. [substeps] Take a step back and collect your thoughts.', \\\"You and your spouse may disagree on many issues, especially important to a child or toddler : [substeps] One parent cannot take over the entire household all by themselves. The child or toddler has to ask for their parent's help and parents let the other parent handle the children, rather than take charge.\\\", \\\"Remind yourself that you can't argue with this person. If you communicate assertively, your spouse will understand.\\\", 'Instead of arguing, stay as calm and collected as possible. You can disagree with your spouse without yelling or being disrespectful.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}