{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"73fe9089-5d10-52a5-9831-63bddd94cfd4","task_key":"default--validation--3028","task_revision_id":"1","upstream_id":"3028","short_description":"HellaSwag validation 3028","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to change the password to a saved wireless network on a windows vista pc [title] Open the wireless networking control panel options button. [step] Single click the internet button from the bottom right corner of your windows taskbar and click networking and sharing center. [substeps] The network and sharing center is also able to be accessed through the control panel.\",\"endings\":\"['If you don\\\\'t have access to this screen, go to start] properties] network-] sharing. [title] Look under network posts and links for \\\" network properties \\\" and click on \\\" network & sharing center \\\"; this will be the blue button below the network and sharing center.', 'Click network adapter options from the options above to view the network management pane of the network and sharing center section. The network and sharing center window will appear under network and sharing center, and control panel.', '[title] Select the \\\" properties \\\" option from the list of network objects in the options pane. [title] Click \\\" manage wireless networks \\\" tab.', 'Open control panel, type network in the search box at the top of that dialog box and click \\\" network and sharing center \\\". [title] Look for a bar on the left side that displays several options and click the \\\" manage wireless networks \\\" option from that bar.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}