{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"371c361e-58fd-5a4e-8df5-ac58e6fc84b3","task_key":"default--validation--33556","task_revision_id":"1","upstream_id":"33556","short_description":"HellaSwag validation 33556","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to deal with your sexually active teen [title] Ask questions. [step] One of the best ways to deal with your teen is to work on effective communication. This is especially true when they become sexually active.\",\"endings\":\"[\\\"They may confide in you about the activity they're doing, or refuse to tell you they're having an emergency, such as a visit to the bathroom after work. Whatever the problem is, listen for answers when they can, and encourage them to share your concern.\\\", 'They will answer things that you are asked and most importantly, let the answer come to you. [substeps] Listen closely to what they say when they answer.', \\\"It's important for the two of you to have productive conversations. Asking good questions is a big part of that.\\\", 'Before you start talking to your teen, ask questions. These will help you and your teen understand why they feel like they need to avoid sex for a few weeks.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}