{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f1362623-0c8b-5009-b497-3fc62ae3d2e5","task_key":"default--validation--17591","task_revision_id":"1","upstream_id":"17591","short_description":"HellaSwag validation 17591","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to access a linksys router [title] Locate a linksys router's default gateway for windows users. [step] The device's default gateway address will need to be located so that you can gain access the web interface for the router. Open the start menu and type \\\" cmd \\\" into the search field, located just below the all programs menu.\",\"endings\":\"['You should find the default gateway of the router you have access to. [substeps] \\\" t2skip \\\" may appear next to \\\" from/author \\\" but this is not a default gateway.', 'The command screen will open on the desktop. [substeps] Type \\\" ipconfig \\\" into the command screen to pull up the device\\\\'s configuration information.', \\\"[substeps] Once you've located the default gateway, press and hold the windows key-pad to bring up the system login screen. At the login screen, enter your username and password and press the opt key to sign in.\\\", '[title] Click on \\\" ipconfig \\\". [step] A drop-down menu will appear asking you to select the primary gateway and ip address of that router.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}