{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1f0c8b47-7c46-5ca6-8848-73b8b4f120f0","task_key":"default--validation--46897","task_revision_id":"1","upstream_id":"46897","short_description":"HellaSwag validation 46897","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to get commercial property insurance [title] Check your state's law. [step] The state in which your business is located may require specific minimum amounts of commercial property insurance. These requirements represent the minimum commercial property insurance you must purchase for your business.\",\"endings\":\"[\\\"Check the state's law to get the maximum commercial property insurance coverage for your business. [substeps] Some states for example are kansas, illinois, maine, massachusetts, idaho, oklahoma, oregon, and tennessee.\\\", \\\"[substeps] If your business is located in someone else's state, you must purchase commercial property insurance for the business in which you live within the state. In illinois, for example, you must purchase commercial property insurance with the permission of your business's zoning division.\\\", '[substeps] The article provided is a guide to making sure you meet the minimum required minimum required by your state. Generally, the amount of commercial property insurance you must purchase is $13 , 920.', \\\"[substeps] You can contact your state's insurance commission to find out if there are any insurance requirements that apply to your business. You also might check with a local small business association or chamber of commerce.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}