{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b314859f-bd9b-566e-8001-2cb332db65e7","task_key":"default--validation--47629","task_revision_id":"1","upstream_id":"47629","short_description":"HellaSwag validation 47629","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to handle loved ones critical of your divorce [title] Decide how much you're comfortable revealing. [step] You may be able to overcome criticism about your divorce by opening up about your reasons. Some family and friends may not be privy to the details of your relationship, and may need to be brought up to speed.\",\"endings\":\"['[title] Assess whether your discussions about why you separated came out. [step] Find out what your questions were after the divorce and attempt to address them with your loved ones.', \\\"However, others may be more sensitive to the changes in your lives and may benefit from some limited discussion. [substeps] It's okay to share sensitive information, especially your relationship history, once you've talked it through together.\\\", 'Put some thought into how much you want to share with family and friends. [substeps] In some cases, depending on how close you are to the other person, more of an explanation may be required to get their support.', \\\"Talking about your personal values may help you decide if talking about your divorce is a good idea. [substeps] Consider letting family and friends know what you're comfortable telling them.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}