{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"18faa78f-1691-5064-be18-d2025e9c880b","task_key":"all--test--18faa78f-1691-5064-be18-d2025e9c880b","task_revision_id":"1","upstream_id":"","short_description":"A 15 year-old minor who looks older than his years purchased a car from a…","config":"all","split":"test","body":"{\"choices\":\"['No the seller must return the down payment because the minor has declared his disaffirmance of the contract.', 'The seller cannot keep the down payment and cannot obtain any other benefit from the transaction.', 'The seller can sue the minor for misrepresentation and fraud in not revealing his age prior to buying the car.', 'The seller can obtain only the reasonable value of the use of the car in a restitution action.']\",\"question\":\"A 15 year-old minor who looks older than his years purchased a car from a private seller. The minor paid $2000 down and agreed to pay the remaining $4000 in installments over the next two years. The minor had to have the car for work because he had no other means of support. The minor later crashed the car in an accident. He disaffirmed the contract, returned the damaged car, and demanded his down payment back. Does the seller have a right to obtain any consideration in this matter?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}