{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4d846c40-e379-5ece-8b56-fdb26abb7624","task_key":"default--validation--15645","task_revision_id":"1","upstream_id":"15645","short_description":"HellaSwag validation 15645","config":"default","split":"validation","body":"{\"activity_label\":\"Cars & Other Vehicles\",\"ctx\":\"[header] How to replace a texas driver's license [title] Find a dmv office near you. [step] To replace your lost or stolen license, you will have to show up to a dmv office in person. Use your city or postal code to search online for the nearest texas location.\",\"endings\":\"[\\\"[title] Obtain a copy of your driver's license. [step] If you cannot find your expired or stolen, you will need to get a copy of the actual driver's license issued by the county where you live.\\\", \\\"Some useful information to keep in mind is that texas's dmv is located in every county in the united states, not only in the u.s. it's located in tennessee, canada, illinois, and wyoming.\\\", 'For searchable listings of all texas dmv offices, visit the dmv website at. [substeps] Check the operating hours of each office before visiting one, as they can vary between locations.', \\\"[substeps] For example, in illinois, you will usually need a valid texas identification number (tva) or a state identification card associated with a driver's license. You can download an online map of your nearest car dealership to use.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}