{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"69747824-a1fc-5624-b398-e69e56f5acc3","task_key":"all--test--69747824-a1fc-5624-b398-e69e56f5acc3","task_revision_id":"1","upstream_id":"","short_description":"Connie Computer decided to purchase a $1,000 laptop computer to use during law…","config":"all","split":"test","body":"{\"choices\":\"['Connie, under the common law because the predominate purpose for which the parties contracted was the sale of goods.', 'Connie, under the UCC only if the predominate reason for entering into the contract was for the goods portion of the contract.', 'Connie, under the UCC unless the predominate purpose of the agreement was for the service agreement portion of the contract.', 'Computer Retailer, if the court determines that the predominate purpose of the agreement is determined by intent and not the relative dollars assigned to the computer and the service agreement.']\",\"question\":\"Connie Computer decided to purchase a $1,000 laptop computer to use during law school. When she went into Computer Retailer Inc., the salesperson also sold her a 5-year service agreement for $1,200 for a total price of $2,200. Nine months later, the laptop stopped working and Computer Retailer refused to perform on their service agreement. If Connie sues Computer Retailer, the trial court will likely find for\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}