{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"00ba10eb-05e1-5c7b-b090-486bf7771324","task_key":"default--validation--685","task_revision_id":"1","upstream_id":"685","short_description":"HellaSwag validation 685","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to maintain boundaries with family living nearby [title] Don't feel obligated to attend every family event. [step] The best part about living close to family is that you're able to be a part of each other's lives. This includes attending meaningful events, such as birthday parties, bar mitzvahs, and soccer tournaments.\",\"endings\":\"['If you have certain serious health conditions that are prohibitively dangerous, you should not go to these events. [substeps] Some groups such as mental health america forbid such events.', \\\"That said, it's important to realize that you are not obligated to attend all of the events your family members invite you to. [substeps] You don't need a specific excuse either.\\\", \\\"Don't pressure your family into attending all of these events if you are not a member. [substeps] You might not feel comfortable inviting just family members.\\\", 'You want to be available each and every time, even if it is by phone or in a group setting. However, there are plenty of things that you want to contribute to the lives of your family, too.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}