{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"00515774-5efa-5191-8a19-04e3c0702455","task_key":"default--validation--38270","task_revision_id":"1","upstream_id":"38270","short_description":"HellaSwag validation 38270","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to do a private adoption [title] Explore your eligibility to adopt a child. [step] There is not a constitutional right to adopt a child. As a result, all adoption rights, procedures, and requirements are governed by state statutes with some guidance from the federal government.\",\"endings\":\"['[substeps] To learn more, contact your local police branch or your local shelter. Search their website for \\\" adoption adoption agencies \\\" and look at the section in the internet for \\\" adopt an orphan child \\\".', 'Adopting a child will enable you to legally allow him or her to provide adequate life support, too. [substeps] A valid joint copy of the original executed deed that was acquired at a government agency may make a valid legal separation, but you will not be able to file for a court order of civil adoption.', 'In general, under current state laws, any single adult or married couple is eligible to adopt if they meet certain criteria. [substeps] Age requirements of prospective parents, if listed in the statute, range from 18 to 25.', \\\"These statutes recognize modifications to their ordinances, and provide laws that mandate you adopt a child's right to survivability. [substeps] Some states may have transitional rights or military privileges you can enroll in that are not dependent on your consent for the birth of your child.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}