{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c4454433-b33b-57a4-99c9-5791d0076606","task_key":"default--validation--46522","task_revision_id":"1","upstream_id":"46522","short_description":"HellaSwag validation 46522","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to stop being obnoxious [title] Admit your faults to yourself. [step] Before you can fix your behavior, you must admit it first. Nobody likes to admit their faults, but by admitting the problem, you're making yourself conscious that \\\" ok, i have a problem, but i'm going to try my best to fix it \\\".\",\"endings\":\"[\\\"Face a particular problem and address it before you escalate the situation. [substeps] This can be hard to do when someone's making you uncomfortable.\\\", \\\"Admit your mistakes without blaming anybody else, and don't be too hard on yourself. Not only will this help you improve, but it will show an increase in maturity, by accepting your faults.\\\", '[substeps] Admitting that you have a problem is the first step towards smoothing up your backside. Sometimes you just need to admit you have a problem.', \\\"Instead of blaming yourself for any mistakes you made, admit to yourself that you're not perfect or stupid. [substeps] For example, your coworker asks you to help them sort clothes for an assignment.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}