{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1f1d442e-60b6-5249-b27d-485cd3ab5b8d","task_key":"default--validation--33035","task_revision_id":"1","upstream_id":"33035","short_description":"HellaSwag validation 33035","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to find a child given up for adoption [title] Gather necessary information. [step] You should gather as much information about the child as you can. This information will be useful if you need to petition a court to unseal adoption records or if you need to search for the child using the internet.\",\"endings\":\"['[substeps] If you have an attorney, you can get their help. You can call 1-800-367-7092.', 'Among the information you should try to get : [substeps] The name of the agency you went through (if you worked with an adoption agency). The location (state and county) where the adoption took place.', '[substeps] A court may have a \\\" fill in the blank \\\" form available for you to use to open a legal document. Obviously, you will be giving the child up for adoption, so ask a friend or family member to assist you and simply write down any helpful information.', '[substeps] You will need plenty of affidavits or other documents to support your search. You should gather these documents when you are not ready to begin your search.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}