{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"26d7ac06-79f3-55a4-bd35-afda744767fc","task_key":"default--validation--25286","task_revision_id":"1","upstream_id":"25286","short_description":"HellaSwag validation 25286","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to adopt an adult stepchild [title] Check state and local requirements. [step] Adoption procedures and requirements vary significantly among states, and specific cities or counties may have additional steps you must complete. Before you begin the process of adopting an adult stepchild, make sure adoption will serve the goals you have in mind.\",\"endings\":\"['[substeps] Most states would require that you be at least 18 years of age. Depending on where you live, there may be particular requirements a judge will abide by, such as age of consent.', '[substeps] Some states have a specific requirement for the adopted mom to have a legal mother and a legal partner. In other states, the adoption will be final after an established parental relationship develops.', \\\"[substeps] The adoption process typically isn't complicated, and you can usually do it without an attorney. However, you may want to consult an experienced adoption attorney if you're unsure whether adoption will do what you want it to do.\\\", '[substeps] Pre-adoption generally takes about 90 days to complete. While this process may vary slightly among states, it generally takes between 180 and 120 days to begin adoption in california, oregon, northern california, eastern kentucky, idaho, and pennsylvania.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}