{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"56eac137-fbb5-5c08-8918-0d3aa62f902c","task_key":"default--validation--41116","task_revision_id":"1","upstream_id":"41116","short_description":"HellaSwag validation 41116","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to help a child in just a minute [title] Believe that you're an expert on children. [step] All of us have children that we interact with. If you're a parent, or a teacher, of course, you do so almost constantly.\",\"endings\":\"[\\\"Listen to your children and where they are and how they're being treated in a manner that is engaging. If you feel that you're not being helpful to your child, let your kid know.\\\", \\\"If you don't have children of your own, you still might have youngsters in your extended family, or you may have friends who have kids. You may think you know nothing about children.\\\", 'A child has a voice, and you identify it. Children view you as an expert and seek advice.', 'Realize that not every child likes to be handled like he or she does in this age group. This is an environment where the child feels like you care very much for him or her and trusts you.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}