{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3684ad45-0b0e-572d-9ea1-8163d6536440","task_key":"default--validation--30495--variant-46b449e3b626","task_revision_id":"1","upstream_id":"30495--variant-46b449e3b626","short_description":"HellaSwag validation 30495","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to remove whitesmoke [title] Click on \\\" start, \\\" then click on \\\" control panel. [substeps] If using windows 8, position your mouse at the right edge of the screen, click on \\\" search, \\\" then search for and select \\\" control panel. \\\" [title] Click on \\\" uninstall a program \\\" or \\\" add and remove programs.\",\"endings\":\"['[step] Check the box beneath \\\" ad helps remove whitesmoke entirely, \\\" then click on \\\" uninstall that program. \\\" if the \\\" add and remove programs \\\" box pops up, select \\\" not all programs.', \\\"[step] The program will remove whitesmoke's seal from windows 8. [title] Follow the in-panel instructions for the program to uninstall.\\\", '[step] \\\" all of the programs currently installed in windows 7 will be checked off. [substeps] You can also delete programs that you want to remove from the control panel.', '[title] Search for \\\" whitesmoke toolbar, \\\" and select the option to remove the program from your computer. [substeps] In some cases, whitesmoke may only have affected your internet browser settings.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}