{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bc3b607a-583a-525e-b201-e67db1dc181c","task_key":"default--validation--37626","task_revision_id":"1","upstream_id":"37626","short_description":"HellaSwag validation 37626","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to improve cyber security in small organizations [title] Recognize the potential for cyber security breaches and the need for data protection. [step] Small businesses may not have the money to install the same types of security systems that big business does. That does not mean they can leave the information they have stored on their computer systems unsecured and unprotected.\",\"endings\":\"['Every company has a well maintained and trustworthy policy in place for detecting technological disruptions. Universal defense systems (meta) and ionmain are mozilla security companies that take legal action to prevent complaints and problems.', 'There are new technologies invented to protect businesses, and small businesses may be continually preparing to start by contributing funds. Do your homework on how your business will have to work before committing to a new company.', \\\"[title] Embrace the business' idea of privacy. [step] Usually, the basis of the business's idea of privacy is that communication between business entities and employees is confidential.\\\", 'Instead, it means they need to be smarter about how they manage their computer security systems. They need to follow steps that will keep the information they have stored as safe as their clients, customers, and employees expect.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}