{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e86962ee-5eef-59a8-ac7d-fe44a19a0c60","task_key":"default--validation--13642","task_revision_id":"1","upstream_id":"13642","short_description":"HellaSwag validation 13642","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to adopt a child from syria [title] Find a licensed agency to facilitate your adoption. [step] To adopt a child from another country, you must go through an adoption agency that is accredited and approved. You can find a list of approved adoption service providers on the us state department website.\",\"endings\":\"['Then, you can choose a domain name that matches the name you chosen and click \\\" continue \\\" to continue. [substeps] Examples of approved adoption agencies are georgia, louisiana, virginia, maryland, delaware, and oregon.', '[substeps] Accredited agencies typically cost around $59 , 99 usd. Some agencies also take adoptions from foreign countries.', '[substeps] Not every agency has adoption programs set up in every country of origin. If possible, try to find an agency that has experience placing children from syria and other middle eastern countries.', '[substeps] You must file form a, c , 781783 or form g , 49 ;. Find a phone number for general information on how to initiate adoption in syria through your contact list.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}