{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ef7e2f82-ed2d-54f4-b2d2-3da7a815c31c","task_key":"default--validation--40260","task_revision_id":"1","upstream_id":"40260","short_description":"HellaSwag validation 40260","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to help adopted children connect to their native culture [title] Educate yourself about your child's native culture. [step] The more information you have regarding your child's native culture, the better equipped you will be to answer their questions and share insightful information. Information resources available online and at your local library are invaluable in helping you and your adopted child connect with their native culture.\",\"endings\":\"[\\\"Some resources you can consider : [substeps] Wikipedia. This website provides more information to your adopted child's specific culture than it does to your own.\\\", \\\"These resources include books (including photographic books), documentaries, websites, and videos online. [substeps] Visit your local library and talk to the librarian about borrowing some resources regarding your child's native culture.\\\", \\\"[substeps] See wikihow's how to help adopt a child for ideas and study that might help your child connect with their native culture. [title] Pick a school based environment for your child to network with.\\\", 'Keep a list of resources that you are sure your child is well aware of. These are good choices because potential children may look up to you and seek out resources that you have overlooked.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}