{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"07abf297-82ba-5b99-b781-633f05aec286","task_key":"default--validation--11644","task_revision_id":"1","upstream_id":"11644","short_description":"HellaSwag validation 11644","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to spot a spy [title] Check your browser history. [step] If there are unusual websites, or sites that you did not visit, someone may be using your computer. Likewise, if your search history has been cleared out, and you did not do it, someone else may have done so.\",\"endings\":\"[\\\"In these cases, someone has spied on you by directly accessing your computer. [substeps] Remember to turn your machine off when you aren't using it, or have a strong password with letters, numbers, and symbols to lock out unwanted users.\\\", 'Conversely, if your browser history is kept compressed to a single file or is blank in your app library, people may be accessing your computer. Beware, this is not a foolproof method.', \\\"If the problem is related to sports websites, a potential spy might be able to identify you from a different browser tab if it's investigated correctly. [substeps] Even though visit history might take time, your computer may still be registered.\\\", \\\"[substeps] Think about your browser history and change it to more important. It may be more likely that the website may be your internet permalination service because your browser history is older and you aren't sure about how to adjust the history.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}