{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0c8709f7-9b0b-5c7b-9f24-6b2ad1d95314","task_key":"default--validation--40362","task_revision_id":"1","upstream_id":"40362","short_description":"HellaSwag validation 40362","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to stand up for others [title] Be assertive. [step] Don't wait for a bullying victim to speak up and ask for your help. They may feel too threatened to be able to say anything.\",\"endings\":\"['Instead, make a point of being assertational. [substeps] Avoid phrases like \\\" please sit down! \\\" and \\\" attention please.', 'Try to take control of the situation and speak up for the other person first--they may be relieved that they don\\\\'t have to. [substeps] Understand that victims in a confrontational situation may be stuck in a physiological \\\" freeze \\\" trauma response, a common reaction to extreme stress.', 'The first, you need to assess your assertiveness and tell them that you want to stand up for yourself, too. [substeps] When a bullying victim walks up to you, say \\\" excuse me, \\\" then stand up for yourself by saying \\\" i don\\\\'t know what you mean, but i\\\\'m flattered you asked.', 'Or they may come to their own conclusions on their own that are not being backed up by their peers. Understand yourself and who you are by standing up for yourself and following your instincts and take some power in your own decisions.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}