{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"41b870ef-7799-5e8a-bf8a-c1d4c6e1ec88","task_key":"default--validation--32064","task_revision_id":"1","upstream_id":"32064","short_description":"HellaSwag validation 32064","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to create an e map file with e map editor [title] From the main screen of the e-map editor click on the \\\" add map \\\" button to create a new map [title] Click on the \\\" rename \\\" button to change the file name of the map. [title] Type a new name to identify the map. [step] For example \\\" office \\\".\",\"endings\":\"['You will see a blue \\\" new \\\" button. [title] Select the location where you want to place a folder and click \\\" save \\\" to save the map to the map.', '[title] Click on the map \\\" office \\\" to import a floor plan in bmp, gif or jpg format. [title] Click on the \\\" load map \\\" button.', 'Click on \\\" extensions \\\" and then choose the name you want to use from the drop down menu in the drop down menu on the bottom. [title] Right click on the map you want to create and select \\\" design map.', 'If there are plans you\\\\'d like to change, then type \\\" echo \\\" to add a new name to the existing map [title] Open the map editor. [title] Go to the archive path and make sure you aren\\\\'t over/over-named ;.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}