{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"85041ddf-6b73-5d6e-af0b-bdaf11b06ba0","task_key":"default--test--3615","task_revision_id":"1","upstream_id":"3615","short_description":"You add radioactive material whose activity per unit mass was 45.5 s^-1 g^-1 to…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['Dilution factor is 4.0, Original amount of radioactive material is 300 mg', 'Dilution factor is 9.0, Original amount of radioactive material is 800 mg', 'Dilution factor is 10.0, Original amount of radioactive material is 900 mg', 'Dilution factor is 8.0, Original amount of radioactive material is 700 mg', 'Dilution factor is 6.5, Original amount of radioactive material is 550 mg', 'Dilution factor is 7.0, Original amount of radioactive material is 600 mg', 'Dilution factor is 5.5, Original amount of radioactive material is 450 mg', 'Dilution factor is 5.0, Original amount of radioactive material is 400 mg', 'Dilution factor is 7.5, Original amount of radioactive material is 650 mg', 'Dilution factor is 6.0, Original amount of radioactive material is 500 mg']\",\"question\":\"You add radioactive material whose activity per unit mass was 45.5 s^-1 g^-1 to a liquid and then dilute it so the activity per unit mass was 6.5 s^-1 g^-1 . What is the dilution factor and the original amount of radioactive material? Assume 100 mg of radioactive material was added.\",\"src\":\"stemez-PhysicalChemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}