{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"166714f9-4e7b-53b8-909c-af7f9d0a7f61","task_key":"default--validation--17107","task_revision_id":"1","upstream_id":"17107","short_description":"HellaSwag validation 17107","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to download drivers for an inkjet printer [title] Use hewlett packard (hp), north america as an example but the steps will apply to every printer manufacturer and will be equally effective in most instances. [step] Assume that the reader is beginning with a computer (with internet access) and a printer that is unusable. Google will be the browser choice in this example.\",\"endings\":\"['Cpu and motherboard drivers used for desktops can do the trick. Make sure your printer has a \\\" registry \\\" tool located below the task bar on the top.', \\\"[title] Into the google search engine, type the words hp usa and key' enter'. [substeps] Please understand that the first two or three listings on the resulting search page are from sponsored links.\\\", '[title] Use linux to hide the original drive from the reader. [step] Having access to a printer also provides them with greater drive space and will provide them with less limited liability due to the length of time for computers to login.', '[title] Order the brushes by the design of the printer itself. [title] Just click to filter out images when your printer has been placed on a blank canvas and remove the plug adapter from the printer.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}