{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3dfdac40-1fcb-5491-bbbe-39de86d4aa5d","task_key":"default--validation--25894","task_revision_id":"1","upstream_id":"25894","short_description":"HellaSwag validation 25894","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to find a parking spot [title] Download the mobile parking app that is best for you. [step] Open the app store on your smartphone and then open the navigation category. Look for relevant parking apps that meet your key criteria.\",\"endings\":\"['You can find such apps on the app store homepage, on your iphone, or on your computer. [substeps] You can also download the available mobile parking app from from the web page at http: // www.smartaccount.com/search/uncheck/motordcsl4s.', \\\"The list of parking spots will be listed next to your rate app, and you can choose to take other different routes or use a different parking system to find one that meets your needs. Additionally, if parking isn't your cup of tea, you might need to look at sites like monster.com for additional information.\\\", \\\"[title] Look over the categories for available parking spots. [step] Once you've opened the app, navigate to the categories for your near and far-off parking spot.\\\", 'For instance, you may want to choose an app that allows you to pre-pay for parking or sends notifications when your parking is about to expire. If discounts are a priority, some apps have significant deals on entertainment and travel.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}