{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ac23fefc-a4da-570d-8a0d-edd80bc33dba","task_key":"default--validation--13429","task_revision_id":"1","upstream_id":"13429","short_description":"HellaSwag validation 13429","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to calculate an amount to be financed [title] Determine the selling price. [step] For a vehicle, boat, or another type of commercial loan purchase this will be the amount you agree to pay for your new acquisition. It does not include other aspects of the deal such as the trade-in allowance, fees, taxes, and other closing costs.\",\"endings\":\"['[title] Subtract any net trade-in allowance. [step] For auto or boat purchases, among others, a dealer may offer a trade-in allowance or credit for giving them your old car or boat when you buy a new one.', 'Any negotiation will be slightly different, so be sure to talk with your broker about what you want and how much to get. [title] Do not make any forward decisions until you have narrowed your terms.', 'Keep in mind that a profit made on a one-time purchase is dependent on the value of the product. The resulting value as a co-op loan will have a decline that is more noticeable if you purchase the vehicle outright, and be sought after.', '[title] Determine any fees or time limits you have for supplemental financing. [step] The rules regarding the amount purchased vary from state to state, and you should determine if you wish the required amount to be included in your purchase.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}