{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c15cd4b6-dbd3-5d67-8039-a51795a80e84","task_key":"default--validation--21309","task_revision_id":"1","upstream_id":"21309","short_description":"HellaSwag validation 21309","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to become a foster parent in florida [title] Learn how foster parenting works. [step] Foster parenting in the u.s. began with social agencies and was soon endorsed and regulated by state governments in the latter half of the 19th century. Today, the florida department of children and families oversees 18 affiliated community foster care organizations.\",\"endings\":\"[\\\"[substeps] Community foster care can include a bachelor's degree in nursing or nursing, an introductory degree in philosophy, and another collegiate degree in english-language discipline. Community foster care is structured as a process or concept under which the parents form a professional involvement.\\\", '[substeps] Caring for the children in foster care is voluntary. You can opt to become part of an affiliated community or partnership.', 'You can find a map of the affiliated organizations by county. Community organizations recruit prospective foster parents, provide training, place children in foster homes, and provide support and manage the cases of children who have been placed.', 'Because the space is new to them, adults typically need to be around 201 or more adults to set up a youth center. You can find one near you at : [substeps] Www.law.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}