{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fd1de8b0-99c3-58e9-8168-85426e02c752","task_key":"default--test--7459","task_revision_id":"1","upstream_id":"7459","short_description":"What is the difference between \"caveat emptor\" and \"ceteris paribus\"","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"[\\\"'Caveat emptor' is 'Buyer's guarantee' and 'Ceteris paribus' is 'given the circumstances'\\\", \\\"'Caveat emptor' is 'Buyer beware' and 'Ceteris paribus' is 'all things constant'\\\", \\\"'Caveat emptor' is 'Let the buyer beware' and 'Ceteris paribus' is 'all other things being equal'\\\", \\\"'Caveat emptor' is 'Let the buyer choose' and 'Ceteris paribus' is 'other things unchanged'\\\", \\\"'Caveat emptor' is 'Let the seller beware' and 'Ceteris paribus' is 'all things considered'\\\", \\\"'Caveat emptor' means 'Seller's warning' and 'Ceteris paribus' means 'everything else is variable'\\\", \\\"'Caveat emptor' is 'The seller is responsible' and 'Ceteris paribus' is 'all factors constant'\\\", \\\"'Caveat emptor' is 'buyer's choice' and 'Ceteris paribus' is 'equal rights'\\\", \\\"'Caveat emptor' means 'Guarantee for the buyer' and 'Ceteris paribus' means 'considering each part'\\\", \\\"'Caveat emptor' is 'Let the buyer decide' and 'Ceteris paribus' is 'with all other things'\\\"]\",\"question\":\"What is the difference between \\\"caveat emptor\\\" and \\\"ceteris paribus\\\"\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}