{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0223483a-d538-5493-8ff2-b703516110ef","task_key":"default--validation--26360","task_revision_id":"1","upstream_id":"26360","short_description":"HellaSwag validation 26360","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to forget a network on android [title] Open your android's settings app. [step] The settings icon looks like a gray gear or wrench icon on most android devices. [title] Find the wireless & networks heading.\",\"endings\":\"['[step] This button is located in the upper-left corner of your screen. Tap it to open the cellular settings dialog box.', '[step] The wi-fi button is located on the far left corner of the app window, and it will display a list of all the wi-fi networks nearby. Tap on the wi-fi heading to view the wi-fi networks in your region.', '[step] On the main menu of your android device, tap the network gear icon to bring up the wireless network settings menu. [substeps] If the network heading doesn\\\\'t appear in the settings menu, you can find it by swiping down on the radio button at the top of the screen, or by looking at \\\" settings \\\" at the bottom of the screen.', '[step] This section will be at the top of your settings menu. [substeps] Depending on your device model and current software, you might have to tap a connections tab at the top of your screen.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}