{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d0a7df1d-a7e1-58b3-a7fd-ef3aa6372a93","task_key":"default--validation--17818","task_revision_id":"1","upstream_id":"17818","short_description":"HellaSwag validation 17818","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to ask your girlfriend to stop talking to a guy [title] Explain your feelings with \\\" i \\\"-statements. [step] As this is a delicate situation, phrasing things using \\\" i \\\"-statements can help reduce tension as you place the focus on your feelings. Begin with \\\" i feel...\\\" and state your feeling.\",\"endings\":\"['Speak in a firm voice that focuses the conversation on your feelings, not the actual how you feel. [substeps] This is a good way to keep distance between yourselves without allowing her to get defensive.', '[substeps] For example, \\\" i am a fragile person. \\\" this statement will help take the focus off of the conversation so you don\\\\'t sound accusatory.', 'Essentially, this phrase can help your girlfriend know exactly what you don\\\\'t like about her. [substeps] For example, state: \\\" i feel jealous when you talk behind your girlfriend\\\\'s back.', 'Then, explain the behavior that led to that feeling and why you feel the way you do. [substeps] Don\\\\'t come into the situation and say something like, \\\" it\\\\'s hurtful that you\\\\'re so flirtatious with your ex and it makes me insecure.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}