{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a955acd8-738a-5096-9128-2ebd9a0b67b5","task_key":"default--validation--27931","task_revision_id":"1","upstream_id":"27931","short_description":"HellaSwag validation 27931","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to be a friend and advocate for someone with a neurological disability (such as autism or adhd ) [title] Read a bit about the disability, and the disability community. [step] Understanding the perspectives of various disabled people can help you understand what they want, feel, and need. [substeps] There is a strong autistic community presence online, where you can learn more about autism (which includes asperger syndrome).\",\"endings\":\"['[title] Push aside stereotypes and misinformation. [substeps] Autistic people are not necessarily savant-like, sleepwalking through life, unfeeling, or suffering deeply.', 'Many communities give out an over the internet background. Discover areas of interest to be involved in your community by checking out the library, writing pamphlets, watching books or websites, and taking trips to the library.', 'There are organizations dedicated to mental health issues relating to autism. You can find a host of old-fashioned subjects on sites such as disability for mental health networks.', 'It is also a good place to learn about the disability community (the disability community\\\\'s \\\" speech impediments \\\"). Contact tm to learn more about the disability community.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}