{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7751a574-0724-5873-9a79-52dbad1f7562","task_key":"default--validation--40393--variant-12982753127b","task_revision_id":"1","upstream_id":"40393--variant-12982753127b","short_description":"HellaSwag validation 40393","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to become less of a control freak [title] Admit you have issues with control. [step] If you're controlling, you may have a tendency to assume you're right. Recognize when you feel your way is the only way to complete a task.\",\"endings\":\"['Acknowledge that the problem is your need for control and not someone else\\\\'s shortcomings. [substeps] It\\\\'s easy to simply say to yourself, \\\" i have control issues.', \\\"Perhaps you feel like you are always in control of your life, and may not be able to take on even the smallest task. It's good to admit you've been in conflict with your authority figures but that you got into trouble with them.\\\", \\\"You may feel you've let yourself give in to an action because you're worried about making a mistake. [substeps] If you want to learn to control your thoughts and actions, accept that this may not always be possible.\\\", \\\"It's hard to control something someone else is doing, so take the role and deliberately acknowledge that. [substeps] For example, if you have a tendency to react in a house like an abuser, then acknowledge that you can control this situation and that the person in charge cannot.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}