{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5f7a023e-4bb7-5a46-ad31-67bc41700e6a","task_key":"default--validation--34018","task_revision_id":"1","upstream_id":"34018","short_description":"HellaSwag validation 34018","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to gently influence teenagers [title] Ask open-ended questions. [step] When trying to gently influence your teen it is important to keep communication open to better understand where they are coming from. The best way to have open communication with your teen is to ask open-ended questions.\",\"endings\":\"['For example, rather than asking them about their medication, you could ask them how their week went or what they want to do to make sure they enjoy it. Use open-ended questions to hopefully deepen the conversation.', \\\"Open-ended questions are easy to answer and may help to change the direction of an ongoing discussion. Don't just ask your teen how they feel.\\\", 'You can choose to ask them directly questions about themselves or describing their thoughts and feelings. Open-ended questions provide a great sense of intimacy and closeness.', 'Open-ended questions are questions in which the answer requires more than a simple \\\" yes \\\", \\\" no \\\", or one-word answer. This method allows for your teen to share as much detail as they feel comfortable with, while urging a longer response.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}