{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"625c8d16-0e45-5152-acf5-47d7c71ce5f6","task_key":"default--validation--6556","task_revision_id":"1","upstream_id":"6556","short_description":"HellaSwag validation 6556","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to handle your child's first crush [title] Find out if they have a crush. [step] Children as young as elementary school age, and sometimes even preschoolers may decide they have a crush. Often, though, when children have their first crush, parents are the last to know.\",\"endings\":\"['While some kids may share this exciting new with you first, more often they have already told their friends, siblings, and even their teacher by the time you find out. With a little investigating you can find out about their crush so that you can discuss it with them.', 'If your child expresses a crush, you should talk to them. If they do not, contact your parents and ask.', \\\"[substeps] Try researching your child's school or neighborhood and ask the parents directly. Pay attention to areas where the child spends the most time.\\\", 'This can be a potentially thrilling experience and is generally universal. [substeps] Younger kids may get their first crush as soon as they reach age five.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}