{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"03315490-c974-518e-8911-a9022c2e0c3d","task_key":"default--test--3608","task_revision_id":"1","upstream_id":"3608","short_description":"Chlorine is found in nature in two isotopic forms, one of atomiemass 35amuand…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['The isotope of mass 35amu occurs with 80% and the isotope of mass 37amu occurs with 20%', 'The isotope of mass 35amu occurs with 60% and the isotope of mass 37amu occurs with 40%', 'The isotope of mass 35amu occurs with 65% and the isotope of mass 37amu occurs with 35%', 'The isotope of mass 35amu occurs with 25% and the isotope of mass 37amu occurs with 75%', 'The isotope of mass 35amu occurs with 50% and the isotope of mass 37amu occurs with 50%', 'The isotope of mass 35amu occurs with 85% and the isotope of mass 37amu occurs with 15%', 'The isotope of mass 35amu occurs with 90% and the isotope of mass 37amu occurs with 10%', 'The isotope of mass 35amu occurs with 55% and the isotope of mass 37amu occurs with 45%', 'The isotope of mass 35amu occurs with 70% and the isotope of mass 37amu occurs with 30%', 'The isotope of mass 35amu occurs with 77.35% and the isotope of mass 37amu occurs with 22.65%']\",\"question\":\"Chlorine is found in nature in two isotopic forms, one of atomiemass 35amuand one of atomic mass 37amu. The average atomic mass of chlorine is 35.453amu. What is the percent with which each of these isotopes occurs in nature?\",\"src\":\"stemez-PhysicalChemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}