{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3801e5fa-7dfa-587d-a04d-595549b0bc0e","task_key":"default--validation--12230","task_revision_id":"1","upstream_id":"12230","short_description":"HellaSwag validation 12230","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to get your husband to stop looking at porn [title] Write down your main points. [step] Maybe you have recently discovered that your husband looks at porn. Or perhaps this has been an ongoing issue in your relationship.\",\"endings\":\"['Either way, its time to have an honest conversation about your feelings. [substeps] Prepare to have an open conversation about the problem.', 'Keep this in mind as you craft the next point and work towards discussing your reasons for wanting to lash out. You may write down the most important points and focus on what you say.', \\\"While your husband has no business being aware of this problem, he's not the only person trying to stop you from seeing porn. [substeps] Maybe your husband is no longer watching porn because he has another job job.\\\", \\\"Perhaps you just can't stand watching porn and have tried to stop. Either way, list the main reasons why you have tried to stop him.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}