{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c5a81aa8-e63b-527f-8d6a-188178677da8","task_key":"default--validation--20729","task_revision_id":"1","upstream_id":"20729","short_description":"HellaSwag validation 20729","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to talk about suicide within the family [title] Be honest. [step] Unfortunately, suicide can carry a stigma with it that may prevent people from wanting to talk openly about it. If your family has experienced the suicide of someone close to you, though, you need to talk about it in order to heal.\",\"endings\":\"[\\\"Say what you want to happen, but communicate clearly, in a way that is hurtful. [substeps] Don't share uncomfortable details or grievances in public, in front of family and friends, or with religious groups.\\\", \\\"[substeps] If you can simply explain that suicide cannot be taken seriously, people likely won't want to visit you any more. But if, despite your knowledge, the person before you explains that suicide cannot be taken seriously, most of your people in your family may want to talk about it.\\\", \\\"You should not talk about your loved one's suicide in front of others, who might interpret this as your opinion. You may feel embarrassed to tell about someone's suicide or even feel uncomfortable talking about it with your family members.\\\", 'You can have this discussion if you are all honest about what happened and how it is affecting you. [substeps] Encourage family members to say \\\" died by suicide \\\" or similar phrases instead of euphemisms like \\\" passed away that way \\\".']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}