{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"02543344-a921-55fb-88d9-edb70c6ffd58","task_key":"default--validation--43955","task_revision_id":"1","upstream_id":"43955","short_description":"HellaSwag validation 43955","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use the fitbit dashboard [title] Download and install the fitbit app. [step] This app is free and will enable you to connect to your fitbit. Make sure you are using the most recent version of your software, or else you might have difficulty linking your device and fitbit account.\",\"endings\":\"['[title] Connect to the dashboard through the dashboard navigation bar at the top of the dashboard. [step] When prompted on the dashboard, follow these steps to : [substeps] Connect your device to the dashboard input port.', '[substeps] You can download the app from the app store app store. If you cannot find the app store app, look for the app app on the mobile app store website.', '[substeps] The fitbit app can be found in the windows store, google play store, or apple store. If your device supports bluetooth, you will need to turn your bluetooth on before attempting to use your fitbit account.', '[substeps] Visit the fitbit dashboard app store by clicking on the apple menu and select \\\" home \\\" or \\\" home \\\" from the menu. Enter \\\" fitbit dashboard \\\" in the search bar and hit \\\" home \\\" to download it.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}