{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b46ad2f8-bba8-5e01-8396-3cf99f478d2a","task_key":"default--test--9808","task_revision_id":"1","upstream_id":"9808","short_description":"A cyclotron has an oscillator frequency of 11.4 Mc \\bullet s^-1 and a radius of…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['0.77 Wb m^-2, 0.165 × 10^-11 J, 1.15%', '0.72Wb\\\\x08ulletm^-2, 0.145 × 10^-11 J, 0.95%', '0.75Wb\\\\x08ulletm^-2, 0.160 × 10^-11 J, 1.10%', '0.80 Wb m^-2, 0.172 × 10^-11 J, 0.92%', '0.76 Wb m^-2, 0.158 × 10^-11 J, 1.00%', '0.65 Wb m^-2, 0.120 × 10^-11 J, 1.05%', '0.748Wb\\\\x08ulletm^-2, 0.154 × 10^-11 J, 1.02%', '0.68Wb\\\\x08ulletm^-2, 0.132 × 10^-11 J, 0.98%', '0.73 Wb m^-2, 0.142 × 10^-11 J, 1.08%', '0.70 Wb m^-2, 0.138 × 10^-11 J, 0.99%']\",\"question\":\"A cyclotron has an oscillator frequency of 11.4 Mc \\\\bullet s^-1 and a radius of 60 cm. What magnetic induction is required to accelerate protons of mass 1.67 x 10^-27 kg and charge 1.6 × 10^-1 9 C, and what is the final energy that they acquire? What error is made by assuming that the mass of the protons remains constant?\",\"src\":\"stemez-Physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}