{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d6de7223-6d14-5b03-864e-cc8287db7778","task_key":"default--validation--40983","task_revision_id":"1","upstream_id":"40983","short_description":"HellaSwag validation 40983","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to present yourself and business powerfully [title] Show your confidence in yourself. [step] When you make a presentation, whether to one person when you attend networking events or to 100 people when you make a formal presentation, project competence and authority, regardless of your position, to move ahead in your career or move your business to the next level. First impressions are crucial.\",\"endings\":\"['Try to address people, not just yourself, through your act of speaking. [substeps] Be nice when approaching each person, including your boss, co-workers, or business associates.', 'Use good manners and greeting to point people toward your own strengths. [substeps] Avoid impolite and unprofessional comments, which can come across as wrong.', 'Make sure your statements are concise, not rhetorical. This shows you respect the values of others and is an asset for you as a business person.', \\\"Often, the first impression you make is when you shake someone's hand in greeting. Your handshake communicates critical information.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}