{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"01260f65-59ac-5520-9108-1bf75e58c025","task_key":"default--validation--147","task_revision_id":"1","upstream_id":"147","short_description":"HellaSwag validation 147","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to gain a cat's trust [title] Understand your cat's mindset. [step] You won't be able to force your cat to do anything, let alone to trust you. Instead, the cat has to be convinced that she'll benefit from an action.\",\"endings\":\"[\\\"What this means, of course, is you giving up control of your cat's life. If your cat is not able to trust you, she can't be trusted with you.\\\", 'Instead of forcing your shy cat to do something, your cat will do it consistently. When the cat first starts to trust you, give it time and attention.', 'In order to establish trust, your cat needs to be educated. She needs to be taught how to interact with another cat, how to look like her and how to obey commands.', \\\"For example, maybe she'll give up her nap if you offer her her favorite treat. Don't be offended if she decides not to be persuaded.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}