{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d216b8cd-d640-5a32-bc2a-ca6f9cece228","task_key":"default--test--9294","task_revision_id":"1","upstream_id":"9294","short_description":"The radiation from an x-ray tube operated at 50 kV is diffracted by a cubic KC1…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['0.245 Å and 2.10 degree', '0.248 Å and 2.25 degree', '0.250 Å and 2.30 degree', '0.235 Å and 2.20 degree', '0.262 Å and 2.28 degree', '0.242 Å and 2.33 degree', '0.260 Å and 2.40 degree', '0.250 Å and 2.18 degree', '0.240 Å and 2.15 degree', '0.256 Å and 2.35 degree']\",\"question\":\"The radiation from an x-ray tube operated at 50 kV is diffracted by a cubic KC1 crystal of molecular mass 74.6 and density 1.99 × 10^3 kg\\\\textbulletm^-3. Calculate (a) the short- wavelength limit of the spectrum from the tube, and (b) the glancing angle for first-order reflection from the princi-pal planes of the crystal for that wavelength.\",\"src\":\"stemez-Physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}