{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"973b1e8b-01d8-52d4-91a8-4142b90bc247","task_key":"default--validation--27829","task_revision_id":"1","upstream_id":"27829","short_description":"HellaSwag validation 27829","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to stop a verbally abusive husband [title] Make different choices about how to respond. [step] You can't change his behavior, but you can prevent your own feelings from plunging you into depression. If this happens often, you probably go right from hearing the abuse to feeling bad.\",\"endings\":\"['These mood swings are normal, but they can often end for many reasons. Try to stay emotionally composed at all times.', 'Taking responsibility for your decision can help improve your relationships in the long run, and preserve your chances for recovery. [substeps] Tell him to stop immediately if it will help your closure in the long run.', 'If this happens every day, think about what you can do to learn from this situation. [substeps] Start by making a list of things you can do to change the behavior.', 'Think about the step in between-your belief about what happened and why. Chances are, the reasons for what happened are not specifically about you, but about the frustration and rage of your husband.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}