{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ff05f803-8a61-5cb6-8d78-f4c9c8885d4d","task_key":"default--test--3551","task_revision_id":"1","upstream_id":"3551","short_description":"The $J=2$ to 3 rotational transition in a certain diatomic molecule occurs at…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['315.2 $\\\\\\\\mathrm{GHz}$', '252.8 $\\\\\\\\mathrm{GHz}$', '158.6 $\\\\\\\\mathrm{GHz}$', '347.2 $\\\\\\\\mathrm{GHz}$', '283.2 $\\\\\\\\mathrm{GHz}$', '210.8 $\\\\\\\\mathrm{GHz}$', '189.6 $\\\\\\\\mathrm{GHz}$', '226.4 $\\\\\\\\mathrm{GHz}$', '126.4 $\\\\\\\\mathrm{GHz}$', '378.0 $\\\\\\\\mathrm{GHz}$']\",\"question\":\"The $J=2$ to 3 rotational transition in a certain diatomic molecule occurs at $126.4 \\\\mathrm{GHz}$, where $1 \\\\mathrm{GHz} \\\\equiv 10^9 \\\\mathrm{~Hz}$. Find the frequency of the $J=5$ to 6 absorption in this molecule.\",\"src\":\"scibench-quan\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}