{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"849a519a-3249-59f4-a3fc-72f477cd56f2","task_key":"default--validation--42607","task_revision_id":"1","upstream_id":"42607","short_description":"HellaSwag validation 42607","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get to channel islands national park [title] Read up on all of the fees involved in a visit to the channel islands. [step] The park's website lists all of the expenses you'll incur during your trip : [substeps] General admission to the park is free. Those wishing to camp on one of the islands will be charged a fee of $15 per campsite per night.\",\"endings\":\"['The money is used to help preserve the park. Reservations must be made ahead of time, and can be arranged via the national recreation reservation service website.', 'Pay for admission by airline, park sign, ticket, or card. Water and entertainment are not as much an issue.', 'Temporary admission to the park is $14. Check out their website before you leave for your trip.', \\\"Transportation to and from the park is free as well. [title] Confirm that you're registered to bring a valid passport.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}