{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"01955a3d-b825-5aef-9d11-dda2fa2aef2d","task_key":"default--validation--18715","task_revision_id":"1","upstream_id":"18715","short_description":"HellaSwag validation 18715","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to remove an application (game) off your facebook account [title] Log in to facebook. [step] Type in your username and password when prompted. [title] Locate the particular game/app that you intend to remove.\",\"endings\":\"['[step] This will be under the app category under \\\" settings. \\\" on the left sidebar, you should find \\\" games \\\" under \\\" apps.', '[step] Find the game/app, and download it to your computer. If you find it, navigate to the game/app download page and download the app : [substeps] Games for cfu game.', \\\"[step] Once you type in the name, you will be brought to the bottom of the list and must select it, otherwise the menu will close and you cannot see the game/app's icon yet. [substeps] The app icon is the middle portion of the app that is located to the right of the apple id card icon.\\\", \\\"[step] Some activities are alike but for those activities which are more restricted, some can be blocked. Remember that what you're viewing/listening to and wanting to view on facebook is all unique.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}