{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"64d3b675-07af-51e3-b901-523239b80a2a","task_key":"default--validation--33736","task_revision_id":"1","upstream_id":"33736","short_description":"HellaSwag validation 33736","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to be a dominatrix [title] Never assume consent. [step] Consent must be freely given. A person who is intoxicated or unconscious cannot consent.\",\"endings\":\"['Consent should come either voluntarily or in a controlled manner, without any doubt or hesitance. It is a taboo, not a pleasurable activity or a wonderful thing.', 'For some sex, blood is exchanged (for men) or saliva (for women). Some people also engage in sexual activities like kissing, touching, and making love without a condom.', 'A person with a history of drugs and alcohol use with a loved one cannot be abstinent. If a person is drunk, they cannot continue sexual intercourse until they are completely sober.', \\\"It's best to check in from time to time to make sure. Of course, with bdsm it can be trickier to ensure consent, which is why it is important to set boundaries beforehand.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}