{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"df1d4c7b-5fdd-5835-aa3c-ae09c801b67b","task_key":"default--validation--11312--variant-4302eaf36fce","task_revision_id":"1","upstream_id":"11312--variant-4302eaf36fce","short_description":"HellaSwag validation 11312","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to accept defeat gracefully [title] Become aware of your emotions. [step] Think about what you just experienced, and try to understand how you are currently responding to it. If you are angry, ask yourself why you are angry.\",\"endings\":\"['Perhaps the other person upset you is feeling the same way. If you are sad, ask yourself what happened and why.', 'If you are upset, then try to reflect how you would react. [substeps] Thinking about the emotions you experienced may help you then decide how to respond in an alright calm, rational way.', 'Your response will likely take some time to process and come to a conclusion. [substeps] Take a deep breath and repeat to yourself, \\\" i am powerful and not afraid to take my opponent out.', 'If you are disappointed, ask yourself what you hoped to achieve. Before you accept or control your emotions, you must first understand them.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}