{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1a530c9c-0dd0-5d50-9d5f-5db4f179c91f","task_key":"default--validation--5667","task_revision_id":"1","upstream_id":"5667","short_description":"HellaSwag validation 5667","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to get rid of annoying people without hurting their feelings [title] Communicate your boundaries. [step] Be clear but polite about any boundaries that you have with the annoying person. These boundaries can remain the same or they can change depending on the conversation or circumstance.\",\"endings\":\"[\\\"[substeps] Always state your boundaries and ensure that the annoying person can and will respect them by not interrupting you when you're speaking. If the annoying person will not leave you alone, it is not okay to argue and instruct them to leave you alone.\\\", 'You can give a reason for your boundary to minimize hurting their feelings, but you do not have to explain your boundaries. [substeps] For example, if a classmate is always interrupting your study session you might say something like, \\\" i don\\\\'t mean to be rude but i have two more hours to study before my exam.', '[substeps] For example, perhaps you are making a complaint and the annoying person responds by calling you names. Or maybe you are trying to find a job and the annoying person does not seem interested to help.', \\\"[substeps] You may text or tweet or call the annoying person every time you see them, or you may leave the person a voicemail or call one of their friends. If the person doesn't stop annoying you, attempt to communicate this with the annoying person so that they can get a different perspective on the situation.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}