{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"74ed1d34-e443-5214-a2f6-7991a4026f91","task_key":"default--test--5981","task_revision_id":"1","upstream_id":"5981","short_description":"Under the Sales Article of the UCC, which of the following circumstances best…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['The seller knows the particular purpose for which the buyer will use the goods and the seller is a professional in such goods.', 'The seller knows the particular purpose for which the buyer will use the goods, but the buyer is not relying on the seller’s skill or judgment to select suitable goods.', 'The buyer is purchasing the goods for a particular purpose and is relying on the seller’s reputation to select suitable goods.', 'The buyer is purchasing the goods for a particular purpose and the seller is a merchant in such goods.', 'The buyer is purchasing the goods for a particular purpose and is relying on the seller’s skill or judgment to select suitable goods.', 'The seller knows the particular purpose for which the buyer will use the goods and knows the buyer is relying on the seller’s skill or judgment to select suitable goods.', 'The seller knows the particular purpose for which the buyer will use the goods and the seller is a merchant in such goods.', 'The seller is not aware of the particular purpose for which the buyer will use the goods but is a merchant in such goods.', 'The buyer is purchasing the goods for a general purpose and the seller is a merchant in such goods.', 'The buyer is purchasing the goods for a particular purpose and the seller is not a merchant in such goods.']\",\"question\":\"Under the Sales Article of the UCC, which of the following circumstances best describes how the implied warranty of fitness for a particular purpose arises in a sale of goods transaction?\",\"src\":\"ori_mmlu-professional_accounting\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}