{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e6d1ee37-8002-5c48-aa97-f81ea82a1984","task_key":"default--validation--24822","task_revision_id":"1","upstream_id":"24822","short_description":"HellaSwag validation 24822","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to add columns in indesign [title] Add columns to a new document. [step] You can change the number of columns in a new document to make working on it easier. [substeps] Create the document by going to \\\" file \\\" and selecting \\\" new.\",\"endings\":\"['\\\" choose a new page from the \\\" page \\\" menu. Go to the \\\" new document \\\" menu.', '\\\" [title] Add columns by left-clicking on them. [step] This will bring up a new window with columns that are already loaded in your document.', '\\\" check the box below \\\" choose columns to add columns \\\" to the document. Look through the new document by clicking the box beside the \\\" empty columns \\\" button.', '\\\" open the document toolbar and select \\\" new. \\\" enter the text that your new blank column contains and click on the envelope icon in the upper right corner to execute the new column command.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}