{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a7aae7e6-0044-595b-b04b-ecb96f17e2bb","task_key":"default--test--4320","task_revision_id":"1","upstream_id":"4320","short_description":"Calculate the Q value of the following reaction (^106 _46)Pd + (^1 _0)n…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['0.7824MeV', '-4.88MeV', '5.60MeV', '1.008665MeV', '4.32MeV', '-1.24MeV', '2.14MeV', '- 2.76MeV', '-0.48MeV', '- 3.54MeV']\",\"question\":\"Calculate the Q value of the following reaction (^106 _46)Pd + (^1 _0)n \\\\rightarrow (^106 _45)Rh+ (^1 _1)H + Q (^106 _45)Rh\\\\rightarrow (^106 _46)Pd + \\\\beta-+ѵ+ 3.54MeV The product (^106 _45)Rhdecays with a half-life of 30 seconds and 3.54MeV\\\\beta particles are emitted to the ground state of ^106Pd.\",\"src\":\"stemez-PhysicalChemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}