{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"85e0e6cd-4229-55e4-a56a-385874eab7b1","task_key":"default--validation--33561--variant-bc90a2428973","task_revision_id":"1","upstream_id":"33561--variant-bc90a2428973","short_description":"HellaSwag validation 33561","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to avoid influences of racism and racist people [title] Assert your boundaries. [step] Know where your boundaries are, and decide what you'll do if someone crosses them. Let the people in your life know what kind of behavior you expect from them.\",\"endings\":\"[\\\"Remember that racism is a part of human beings, so don't let it sway you into making negative choices. [title] Connect your boundaries to human rights and race.\\\", \\\"[substeps] Rather than give a white person's comment a harsh twist, it can help you assert your boundaries by acting calmly. Take the person with you on drive and follow the rules.\\\", '[substeps] For instance, if you\\\\'re hosting a family gathering and some of your relatives are using racial slurs, you could say, \\\" i don\\\\'t find that language acceptable. Please don\\\\'t talk like that in my house.', \\\"[substeps] Warning signs include people that are mean to you or who feel hateful towards others. You don't have to have their best interest at heart when you're opposed to these people.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}