{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0297f645-dc96-59bf-a2b3-81fe657b9262","task_key":"default--validation--2666--variant-e7979bbe1762","task_revision_id":"1","upstream_id":"2666--variant-e7979bbe1762","short_description":"HellaSwag validation 2666","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to travel with children [title] Research destinations. [step] Find out how long it will take to get there, and the optimal route. If it is only a few hours, a car ride may be your best bet.\",\"endings\":\"['If it is closer, and if you are meeting other adults on a walking tour, you might try traveling by bike instead. Likewise, if the distance is more than a few hours, consider exploring the area on foot.', 'If possible, find a place that is popular. If it is a few dollars or less, a bike ride may be a good option.', \\\"If you go farther than that, you are going to waste time. Don't worry, parents will be happy to help with these steps when they find you.\\\", 'If longer than a few hours, deciding between a road trip and air travel is critical. If it will be a road trip, find a route that has interesting landmarks, scenery, and places to take breaks.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}