{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"18d1eeae-9325-5f2f-b617-7828e9655b13","task_key":"default--validation--38050","task_revision_id":"1","upstream_id":"38050","short_description":"HellaSwag validation 38050","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to research adoption on the internet [title] Check national websites. [step] The federal government has adoption resources available, primarily through the u.s. children's bureau's adoptuskids program. On these websites, you can find detailed information about adopting a child.\",\"endings\":\"['The most common sites to find a child are the, , and. [title] Take a dna sample from a running puppy.', '[substeps] The adoptuskids website at adoptuskids.org is a good place to start if you want to research adoption on the internet. This website has national as well as state-specific information about the adoption process.', \\\"You can also go to the national adoption database, which is probably one of the more useful resources for finding adoption professionals. [substeps] In oregon, you can search for laws requiring adoption from the department of human services on your behalf, even if these laws do not require you to apply for an agency's approval.\\\", 'This database will help you learn information about your child, from who lives in the home, where the child lives, and the proposed adoption program. [substeps] The national adoption hotline is a free service designed to work with all adoptions in your area.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}