{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a7e51383-d811-57fe-b53c-a51ff9597056","task_key":"default--validation--10962","task_revision_id":"1","upstream_id":"10962","short_description":"HellaSwag validation 10962","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to find counseling for children of incarcerated parents [title] Contact a guidance counselor. [step] Most public schools offer therapeutic services. This can be with a guidance counselor or with a school psychologist.\",\"endings\":\"['You can talk to the school counselor about your needs and know how to help you. They may suggest other psychological treatments as well, such as joining a group counseling program or volunteering for a cause other than child abuse.', 'Seeking services within the school can be effective on many fronts. For one, counseling offered by the school is free and occurs during school time.', \\\"Counseling sessions are usually brief sessions where you describe the situation and express what you need from the adult. In therapy sessions, you don't focus on using psychotherapy or treating your own mental illness.\\\", \\\"Counseling may be anything from homeschool therapy, a person-teacher counseling program, or a combination of both. You can find the counselor's information by calling or checking their office or phone.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}