{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"63e1babf-141b-5a82-bb48-851118a5e629","task_key":"default--validation--48885","task_revision_id":"1","upstream_id":"48885","short_description":"HellaSwag validation 48885","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to fix a marriage [title] Write down how you feel. [step] While you might want to dive into the issues and what is wrong in your marriage, you won't really be able to know this until you speak with your partner. You should first identify how you feel and then why you feel that way.\",\"endings\":\"['Common ways of thinking are : [substeps] \\\" i love you and i\\\\'m concerned that this relationship isn\\\\'t working out. \\\" \\\" i\\\\'m worried we\\\\'re not doing anything right.', '[substeps] Hopefully, your loved one knows your own reasons for feeling off. That may make it easier to spot errors and come to an agreement on a solution.', \\\"Write down the feeling (angry, distant, hurt, etc. ) and then attribute the feeling to a pattern of interacting (you don't talk with your spouse about work anymore, you stopped date night, etc.\\\", 'Tell your partner the reasons you feel that you can talk them over. [substeps] For example, you might say something like, \\\" i feel...\\\" it will likely be the last thing your partner hears and would be painful for them, if it didn\\\\'t happen at some point.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}