{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9ec49e19-93a0-5896-bca8-4c5cd7ee7b83","task_key":"default--validation--10928","task_revision_id":"1","upstream_id":"10928","short_description":"HellaSwag validation 10928","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to password protect a web page [title] Create or copy the basic code. [step] This method is best if you are hosting your own page or are simply trying to learn more about password protection coding. There are many different variations on code for basic password protection (we've reprinted one), and we will explain how to set your own password and customize the code in a later step.\",\"endings\":\"['[title] Find the code area of the page. [step] Find the space that says \\\" new page \\\".', \\\"[title] Add it to your page's code. [step] In order to implement this code you will need editing access to your web page's underlying code.\\\", '[substeps] Copy the basic code for your web page or your own page that you used to create it. Make sure that the code is easy to remember.', '[title] Locate keywords-nowadays, any keyword-based code is password protected. [step] Keywords are found in the search engine under \\\" options \\\".']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}