{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"63ac2c3d-4b6a-58c1-a537-7f211094c354","task_key":"default--validation--39572","task_revision_id":"1","upstream_id":"39572","short_description":"HellaSwag validation 39572","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to speed up a slow windows computer for free [title] Hold down ctrl + alt + del. [step] This will bring up your pc's task menu. If you have a myriad of programs starting up when you log into your computer, you'll likely have to deal with several minutes of general slow-down.\",\"endings\":\"['In other words, if you tap ctrl + del twice, you\\\\'re moving up to lots of slow programs. [substeps] Once you hold ctrl and del once, say \\\" power off \\\" and select \\\" control panel.', 'Before you start the task screen, set the task to clock out and give yourself time to process your task. Aim for the speed for which you have the most power.', 'To save time, you can hold down the shift key as you leave the control panel. You can also use it to flip over information as you scroll.', 'Disabling startup programs will fix this issue. [title] Click the \\\" task manager \\\" option.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}