{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"31402bca-6fc4-5627-99b0-e8d71d152809","task_key":"default--test--3894","task_revision_id":"1","upstream_id":"3894","short_description":"A silyl radical bearing an Si-H· fragment has a g value of 2.0033 and a pair of…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['15.5 MHz = 0.553 mT = 5.530 Gauss = 5.17 x 10^-4 cm-1', '15.5 MHz = 7.352 mT = 10.104 Gauss = 18.39 x 10^-4 cm-1', '15.5 MHz = 11.104 mT = 27.201 Gauss = 0.862 x 10^-4 cm-1', '15.5 MHz = 0.103 mT = 0.201 Gauss = 2.62 x 10^-4 cm-1', '15.5 MHz = 8.352 mT = 11.104 Gauss = 25.39 x 10^-4 cm-1', '15.5 MHz = 10.553 mT = 20.530 Gauss = 10.17 x 10^-4 cm-1', '15.5 MHz = 2.003 mT = 3.003 Gauss = 21.0 x 10^-4 cm-1', '15.5 MHz = 1.55 mT = 0.562 Gauss = 31.0 x 10^-4 cm-1', '15.5 MHz = 5.55 mT = 15.0 Gauss = 5.5 x 10^-4 cm-1', '15.5 MHz = 3.752 mT = 7.104 Gauss = 1.39 x 10^-4 cm-1']\",\"question\":\"A silyl radical bearing an Si-H· fragment has a g value of 2.0033 and a pair of lines separated by 15.5 MHz. Express the splitting in units of mT, Gauss and cm-1.\",\"src\":\"ori_mmlu-college_chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}