{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1dc971b3-74bf-53a5-b4ea-dc1c0f73a0f5","task_key":"default--test--5257","task_revision_id":"1","upstream_id":"5257","short_description":"On day 1, Jackson, a merchant, mailed Sands a signed letter that contained an…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['No contract was formed because Sands accepted the offer after receiving the revocation', 'No contract was formed because the offer was not in writing', 'No contract was formed because the offer was not signed by Sands', 'A contract was formed on the day Sands received the offer', 'No contract was formed because Sands received the revocation of the offer before Sands accepted the offer', 'A contract was formed on the day Jackson received Sands’ acceptance', \\\"A contract was formed on the day Sands received Jackson's revocation\\\", 'A contract was formed on the day Jackson mailed the revocation', 'A contract was formed on the day Sands mailed the acceptance to Jackson', 'No contract was formed because the offer failed to state an expiration date.']\",\"question\":\"On day 1, Jackson, a merchant, mailed Sands a signed letter that contained an offer to sell Sands 500 electric fans at $10 per fan. The letter was received by Sands on day 3. The letter contained a promise not to revoke the offer but no expiration date. On day 4, Jackson mailed Sands a revocation of the offer to sell the fans. Sands received the revocation on day 6. On day 7, Sands mailed Jackson an acceptance of the offer. Jackson received the acceptance on day 9. Under the Sales Article of the UCC, was a contract formed?\",\"src\":\"ori_mmlu-professional_accounting\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}