{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"839e87f4-9d3f-516f-a22e-6f3343c12e19","task_key":"default--validation--11101","task_revision_id":"1","upstream_id":"11101","short_description":"HellaSwag validation 11101","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to strengthen your relationship with your best friend [title] Communicate with your best friend regularly. [step] Communication is one of the most important aspects of any friendship. If you don't talk to your friend about your thoughts and feelings regularly, you won't know what's going on in the other person's head.\",\"endings\":\"[\\\"[substeps] When you talk, make sure your voice is low and clear. Use a cool tone and don't give your friend the wrong impression.\\\", \\\"You'll only only be making it worse. Make sure to eat well, exercise, and be honest.\\\", \\\"[substeps] While talking to your best friend about personal matters is important, simply chatting about school or catching up on each other's lives is all part of communicating efficiently. If your friendship is long distance, utilize technology and social media.\\\", \\\"[substeps] Communicate with your best friend by calling or texting whenever you're both on the same page. If you're at a party or event, send flowers, drop by her home office, email her, or even call her to vent to her.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}