{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"99f89665-d2d2-5a28-b5c1-7e8030770951","task_key":"all--test--99f89665-d2d2-5a28-b5c1-7e8030770951","task_revision_id":"1","upstream_id":"","short_description":"A buyer contracted to purchase a used car from a seller for $10000. On the date…","config":"all","split":"test","body":"{\"choices\":\"['Damages measured by the difference between the market price and the contract price for the car.', 'Recovery of the contract price of the car.', 'Specific performance.', 'Recovery of the market price of the car.']\",\"question\":\"A buyer contracted to purchase a used car from a seller for $10000. On the date the sale was to take place, the buyer tendered a $10,000 cashier's check to the seller. The seller rejected the tender and refused to deliver the car to the buyer. If the buyer brings an action for breach of contract against the seller, the buyer is entitled to which of the following remedies?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}