{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c2713027-947e-5da8-86e0-fe9c5e0fa86f","task_key":"default--validation--20374","task_revision_id":"1","upstream_id":"20374","short_description":"HellaSwag validation 20374","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to become a foster parent in ohio [title] Learn the responsibilities of a foster parent. [step] A foster parent provides care and a home for children who cannot currently live with their natural parents, often because of abuse or neglect. They take care of the child until the child can safely return home.\",\"endings\":\"['As a foster parent, you are a force of nature who can effectively protect the child during time of abuse and neglect. Foster parents must maintain regular and consistent work and quality checks.', 'The child cannot be taken out of foster care to do the household chores or offer assistance. You can expect a foster parent to communicate with and support children in foster care.', \\\"The foster parent assesses the child's skills, gender and educational needs. Along with raising the child and providing a home for the child, he or she repairs the home's amenities, puts in extra money to start with, and helps the child's caregiver recover.\\\", \\\"Foster parents teach children skills and offer encouragement. [substeps] Foster parents must also be engaged in the child's case.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}