{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"772574ac-516e-59c6-bb67-e4fb8cda258f","task_key":"default--test--2938","task_revision_id":"1","upstream_id":"2938","short_description":"If the activity of an enzyme is constant over a broad range of pH values, it is…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['the enzyme is inactive at all pH values', 'no ionizing groups on the enzyme or substrate participate in the reaction', 'only ionizing groups on the substrate participate in the reaction', 'ionizing groups on both the enzyme and substrate participate in the reaction', 'only non-ionizing groups on the substrate participate in the reaction', 'the enzyme and substrate are both inactive at all pH values', 'the substrate is inactive at all pH values', 'non-ionizing groups on both the enzyme and substrate participate in the reaction', 'only ionizing groups on the enzyme participate in the reaction', 'only non-ionizing groups on the enzyme participate in the reaction']\",\"question\":\"If the activity of an enzyme is constant over a broad range of pH values, it is likely that\",\"src\":\"ori_mmlu-college_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}