{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8ceb5cf9-9af4-58f4-beae-b8d254384675","task_key":"default--test--3834","task_revision_id":"1","upstream_id":"3834","short_description":"The discovery of the element argon by Lord Rayleigh and Sir William Ramsay had…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['0.022', '0.011', '0.003', '0.030', '0.008', '0.025', '0.040', '0.015', '0.018', '0.005']\",\"question\":\"The discovery of the element argon by Lord Rayleigh and Sir William Ramsay had its origins in Rayleigh's measurements of the density of nitrogen with an eye toward accurate determination of its molar mass. Rayleigh prepared some samples of nitrogen by chemical reaction of nitrogencontaining compounds; under his standard conditions, a glass globe filled with this 'chemical nitrogen' had a mass of $2.2990 \\\\mathrm{~g}$. He prepared other samples by removing oxygen, carbon dioxide, and water vapour from atmospheric air; under the same conditions, this 'atmospheric nitrogen' had a mass of $2.3102 \\\\mathrm{~g}$ (Lord Rayleigh, Royal Institution Proceedings 14, 524 (1895)). With the hindsight of knowing accurate values for the molar masses of nitrogen and argon, compute the mole fraction of argon in the latter sample on the assumption that the former was pure nitrogen and the latter a mixture of nitrogen and argon.\",\"src\":\"scibench-atkins\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}