{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c917dc64-91c0-54d2-8a14-171feac76c66","task_key":"default--validation--12862","task_revision_id":"1","upstream_id":"12862","short_description":"HellaSwag validation 12862","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to convert and combine office documents to one pdf [title] Open adobe acrobat pro. [step] Find the \\\" create \\\" function and click it to drop download the list, and you'll see \\\" combine files into a single pdf \\\". [title] Add office documents.\",\"endings\":\"['[step] Click \\\" create pdf \\\" while you\\\\'re downloading the list. The file files will be added after you click \\\" import \\\" on the drop down list, and the dialog box will appear with all the documents you\\\\'ve separated and/or converted to one pdf.', '[step] Use the command \\\" adobe acrobat pro \\\" and click on the name of the file in \\\" add the first \\\" drop down menu. This will open a pop-up asking the for a pdf, click get started, and the username of your pdf in the top right corner on the pop-up.', '[step] At the top left of the \\\" combine files \\\" dialog box, click \\\" add files \\\" and choose the office documents to include. [substeps] In the thumbnail view, you can directly drag and drop files and pages into the desired order.', '[step] Click \\\" create \\\" to create a new pdf by dragging and dropping your pdf. [step] Add also pages, columns, charts, languages, etc.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}