{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b61cca45-57bd-5954-9df5-a4cf4fb2b1c4","task_key":"default--test--1959","task_revision_id":"1","upstream_id":"1959","short_description":"A supermarket signed a contract with a bakery to provide the supermarket with…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['The supermarket would have the right to demand immediate delivery of the 20 whole wheat loaves.', 'The supermarket would have the right to accept the sourdough loaves at a reduced price.', 'The supermarket would have the right to demand a refund for the sourdough loaves.', 'The supermarket would have the right to sue the bakery for breach of contract.', 'The supermarket would have a right to \\\"cover\\\" by purchasing substitute loaves of bread.', 'The supermarket would have the right to reject the fifth shipment and cancel their contract.', 'The supermarket would have no legal recourse and would have to accept the sourdough loaves.', 'The supermarket would not be entitled to reject the operator\\\\'s offer to \\\"cure. \\\"', 'The supermarket would have the right to cancel the contract and seek damages.', 'The supermarket would have the right to reject the fifth shipment, but would be held liable for the remaining deliveries.']\",\"question\":\"A supermarket signed a contract with a bakery to provide the supermarket with 100 loaves of whole wheat bread per week for 12 consecutive weeks. The loaves were to be delivered on the first day of each week, with payment to be made within four days of delivery. For the first four weeks, the bakery delivered loaves to the supermarket and the supermarket made the appropriate payments. When the fifth delivery arrived, the supermarket discovered that the shipment contained 80 whole wheat loaves and 20 sourdough loaves. The manager of the supermarket immediately called the bakery to complain about the shipment. The operator of the bakery apologized and offered to send 20 loaves of whole wheat bread within 24 hours. What is the probable legal effect of the operator's conversation with the manager with regard to the fifth shipment?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}