{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"27962ef7-06da-5d62-a365-046cbeac2980","task_key":"default--validation--40811","task_revision_id":"1","upstream_id":"40811","short_description":"HellaSwag validation 40811","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to have an emotionally healthy divorce [title] Avoid being combative. [step] Because of what you might hear/see on tv and from others who have gotten divorced, you may think that getting divorced has to be a big fight. The truth is, however, that it doesn't.\",\"endings\":\"['Keeping this in mind can help you from being defensive. [substeps] Try to get on the same page with your ex.', 'What has happened in the past has happened, and it is likely that you and your spouse are just as likely to fight in the future. Listening to someone explain what happened is impolite.', \\\"Sometimes, you might feel resentful because you don't feel that the decision is right for you. Studies have shown that to have an emotionally healthy divorce, your spouse has to fight for the outcome.\\\", \\\"Unless you are at fault for what happened, you should avoid using the word' divorce'. It's a way of telling your spouse that you won't see them again because of what happened.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}