{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"684ae966-97c0-5fe3-8c8f-6d82b94632a1","task_key":"default--validation--41028","task_revision_id":"1","upstream_id":"41028","short_description":"HellaSwag validation 41028","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to become a foster parent when single [title] Review the legal requirements for fostering in your state. [step] Each state has different legal requirements regarding foster care. Generally, states do not prohibit single people from becoming a foster parent based solely on the person's single status.\",\"endings\":\"['If you are a single person and have not been deemed eligible for fostering services, fostering care does not require you to be a foster parent. Other states include the following at the end of this section : [substeps] California: age 24 and less eligible for required parental assistance/assistance.', 'However, some states may impose specific, unique and sometimes illegal legal age requirements. [substeps] Young children and adults under age 21 cannot become a foster parent as a result of being a single family member.', \\\"[title] Apply for a fostering license or learner's permit. [step] Most states require all applicants to pass both a physical and written exam before gaining their full fostering license.\\\", 'It is important for a prospective foster parent to review the laws from his or her state to determine whether the prospective foster parent meets the basic legal requirements. The organization adopt us kids provides state-specific foster care information on its website.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}