{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"102beae3-1118-5f92-abbf-d78f940ce9c1","task_key":"all--test--102beae3-1118-5f92-abbf-d78f940ce9c1","task_revision_id":"1","upstream_id":"","short_description":"After his 16th birthday, a youth decided to purchase a new sports car from a…","config":"all","split":"test","body":"{\"choices\":\"['Nothing.', '$10,000. 00', '$18,000. 00', '$24,000. 00']\",\"question\":\"After his 16th birthday, a youth decided to purchase a new sports car from a dealership for the sales price of $36,000. The youth thereafter entered into a written contract with the dealership, which provided that the youth would make monthly payments of $1,000 for three years. During the first year of the contract, the youth made 12 monthly payments totaling $12,000. However, the youth failed to make any payments during the second year of the contract. The dealership repeatedly threatened to sue the youth for the remaining balance that it claimed was due under the contract. Finally, in order to avoid litigation, the youth sent the dealership the following letter:\\\"The car I purchased from you is a real lemon. I have spent a considerable sum of money during the last two years in repair work. I don't believe that the car is worth $36,000, but I am willing to pay you $10,000 if I find ajob in the next month. \\\"The youth had just turned 18 when he sent this letter to the dealership. The day after mailing this letter, the youth was involved in an automobile accident, and the sports car was totally demolished. Following the accident, the youth remained unemployed, and he refused to make any payments to the dealership. At the time of the accident, the sports car was worth $18,000. In this jurisdiction, the age of majority is18 years of age. If the dealership brings suit against the youth for breach of contract, what, if any, is the plaintiff's proper recovery?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}