{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"94169c98-c4a0-53d6-aa31-63426e8b72cd","task_key":"default--validation--3657","task_revision_id":"1","upstream_id":"3657","short_description":"HellaSwag validation 3657","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to make acquisitions in a down economy [title] Investigate the current market value of the asset under consideration. [step] This may or may not be the same as the asking price for the asset. Before making a commitment, you want to know how much you could sell the asset for in today's less than desirable economy and compare that amount to the seller's price.\",\"endings\":\"['Before committing to making a purchase, you should know how the sale will affect the current market price of the asset. Realize that any upfront costs are nothing but bonuses, no matter how much you purchase.', 'If the 2 figures are somewhat close, further consideration of the acquisition may be worthwhile. [title] Project the future movement of that market value.', 'Remember, a lower down market value means better performance. [substeps] Start by deciding if there are any restrictions before making a purchase of the asset.', '[substeps] What is left at the selling price should be kept for the future. When making a bid on the asset, think about how much the value of the asset would cost the seller.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}