{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b4840073-b10e-5955-9646-78d3ab546e48","task_key":"default--test--1476","task_revision_id":"1","upstream_id":"1476","short_description":"In transactions between merchants, what is not true about additional terms…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['They become part of the contract only if both parties are merchants.', 'They become part of the contract only if the offeree does not object within a reasonable time.', 'They become part of the contract only if the offeree agrees to them within a reasonable time.', 'Additional terms always become part of the contract.', 'They become part of the contract only if the additional terms are in writing.', 'They become part of the contract unless they materially alter the agreement.', 'They become part of the contract only if the offeror sends a written confirmation within a reasonable time.', 'They never become part of the contract.', 'They become part of the contract unless the offer expressly limits acceptance to the terms of the offer.', 'They become part of the contract unless the offeror objects within a reasonable time to the additional terms.']\",\"question\":\"In transactions between merchants, what is not true about additional terms proposed in the acceptance?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}