{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6da61843-5a87-5d6f-9ae9-0624160783e5","task_key":"default--validation--20707","task_revision_id":"1","upstream_id":"20707","short_description":"HellaSwag validation 20707","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to buy gold bars [title] Calculate your investment and/or purchase capacity. [step] This will help you choose your product when you make a gold bar purchase from the mint you select later. [substeps] Gold bars for personal purchase typically come in measurements of ounces and/or grams such as : 1 ounce; 10 ounces; 100 grams; or 1 kilogram (32.15 ounces).\",\"endings\":\"['After you have determined your investment and purchase capacity, take the existing gold bars you have obtained to your local mint to determine the capacity of your business. The amount of the resulting gold bars will determine the value of your business.', \\\"Gold bars for personal purchase typically come in sizes ranging from 1 square foot (3.8 square meters) to 1 kilogram (32.5 kilograms). [title] Visit your local mint's wholesale shop.\\\", \\\"The exact price you pay per ounce or gram will depend on market value at the time of your order. Sometimes you can see the real-time stock exchange rate for gold on the seller's website you are choosing.\\\", 'Look for barcodes in gold bars without close inspection. Barcodes only look for a single scale or variable value.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}