{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"11183474-506a-5aac-b325-42f6e414ec1e","task_key":"default--test--11698","task_revision_id":"1","upstream_id":"11698","short_description":"A concentrated charge of 10 microcoulombs exists in an extensive mass of…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['(a) 0.10 joule, (b) 1.0 joule, (c) 10 joules, (d) 100 joules', '(a) 0.50 joule, (b) 5.0 joules, (c) 50 joules, (d) 500 joules', '(a) 0.0001 joule, (b) 0.001 joule, (c) 0.01 joule, (d) 0.1 joule', '(a) 0.020 joule, (b) 0.200 joule, (c) 2.0 joules, (d) 20 joules', '(a) 1.0 joule, (b) 10 joules, (c) 100 joules, (d) 1000 joules', '(a) 0.001 joule, (b) 1.0 joule, (c) 10 joules, (d) 100 joules', '(a) 2.0 joules, (b) 20 joules, (c) 200 joules, (d) 2000 joules', '(a) 0.002 joule, (b) 0.02 joule, (c) 0.2 joule, (d) 2.0 joules', '(a) 0.010 joule, (b) 0.10 joule, (c) 1.0 joule, (d) 10 joules', '(a) 0.005 joule, (b) 0.05 joule, (c) 0.5 joule, (d) 5.0 joules']\",\"question\":\"A concentrated charge of 10 microcoulombs exists in an extensive mass of Bakelite. Determine the total energy contained in the electric field outside a radial distance of (a) 10 meters, (b) 1 meter, (c) 10 centimenters, and (d) centimeter.\",\"src\":\"stemez-Electromagnetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}