{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bc078f94-bfd0-5081-8d21-185067e7f1ba","task_key":"default--test--1609","task_revision_id":"1","upstream_id":"1609","short_description":"A purchaser orally agreed with the seller to buy seller's house for $100,000.…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['Yes, because the check served as a form of acceptance of the offer.', 'Yes, because there was an oral agreement and the check for the down payment was evidence of consideration being paid.', 'Yes, because the seller cannot revoke an offer once a down payment has been made.', \\\"No, because the oral agreement was not legally binding without the seller's signature on the offer form.\\\", 'No, because the offer was not accepted \\\\x80\\\\x94 prior to an acceptance the seller had the right to sell to anyone.', 'Yes, because the written offer and check constituted a legally binding contract.', 'Yes, because the buyer and seller had a meeting of the minds evidenced by their oral understanding, the check and the written offer.', 'No, because specific performance does not apply in a residential real estate transaction.', 'No, because the seller had not yet cashed the check, indicating no formal acceptance of the offer.', 'No, because the post-dated check does not constitute a legally binding agreement.']\",\"question\":\"A purchaser orally agreed with the seller to buy seller's house for $100,000. The purchaser gave the seller a written offer and a post-dated check for 5% of the price. Before the seller signed the offer form or deposited the check, he received an offer of his full asking price of $120,000 from another party. The seller called the purchaser and called the deal off. The purchaser sued for specific performance on the basis that the oral understanding, along with the written offer and the check, constituted an enforceable agreement. Will the purchaser likely prevail?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}