{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"02aefb10-c7f2-5011-83d8-20907d732719","task_key":"default--test--1446","task_revision_id":"1","upstream_id":"1446","short_description":"Question 13. A buyer sent a signed letter to a seller that stated: \"Ship 100…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['A contract was formed when the buyer received the nails, but the arbitration term is not valid as it was not explicitly agreed upon by the buyer.', 'A contract was formed pursuant to conduct when the buyer received the nails, and a court would exclude the arbitration provision from the contract.', 'A contract was formed when the seller mailed its acknowledgment, and the arbitration term must be accepted by the buyer because it was included in the acknowledgment.', \\\"No contract exists, because the arbitration term in the seller's acknowledgment was a new term that was not in the original agreement.\\\", \\\"No contract exists, because the arbitration term in the seller's acknowledgment created a counteroffer that the buyer never accepted.\\\", \\\"A contract was formed when the buyer sent the letter, and the arbitration term is not valid because the buyer didn't agree to it.\\\", 'A contract was formed when the seller mailed its acknowledgment, and the court must decide whether the arbitration term should be excluded as a material alteration of the contract.', \\\"A contract was formed when the seller mailed its acknowledgment, and the arbitration term automatically became part of the contract because the buyer didn't object.\\\", 'A contract was formed when the seller mailed its acknowledgment, and the arbitration term became part of the contract. arbitration term became part of the contract.', \\\"No contract exists, because the buyer didn't respond to the seller's acknowledgment.\\\"]\",\"question\":\"Question 13. A buyer sent a signed letter to a seller that stated: \\\"Ship 100 boxes of nails at $3 per box, the price quoted in your circular.\\\" The seller mailed the buyer a signed form acknowledgment that agreed to the buyer's terms and stated on the reverse side: \\\"Disputes regarding quality shall be arbitrated.\\\" The buyer did not reply to the seller's acknowledgment, and the seller shipped the nails. When the buyer received the nails, it found their quality to be unsatisfactory and sued the seller for breach of warranty. The seller has asked an attorney whether the parties' contract requires arbitration of the buyer's claim. What is the best advice the attorney can provide?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}