{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"47dddac3-a7a6-563c-ad07-9eee7a5c7cc1","task_key":"default--test--9308","task_revision_id":"1","upstream_id":"9308","short_description":"Which of the following would increase the capacitance of a parallel-plate…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['Decreasing the voltage between the plates', 'Using a dielectric material that has a zero dielectric constant', 'Using smaller plates', 'Moving the plates closer together', 'Moving the plates further apart', 'Increasing the voltage between the plates', 'Replacing the dielectric material between the plates with one that has a smaller dielectric constant', 'Increasing the distance between the plates']\",\"question\":\"Which of the following would increase the capacitance of a parallel-plate capacitor?\",\"src\":\"ori_mmlu-high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}