{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"40418b16-1ba9-559c-997c-4153703bf2b7","task_key":"default--test--6385","task_revision_id":"1","upstream_id":"6385","short_description":"Which of the following statements about proteolysis is correct?","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Proteolysis does not involve enzymatic processes.', 'Proteolysis only occurs in animal cells.', 'All tissue proteins undergo catabolism at more or less the same rate.', 'The rate of tissue protein catabolism is more or less constant throughout the day.', 'Proteolysis can only occur in the presence of light.', 'Proteolysis is the process of protein synthesis, not breakdown.', 'All proteins are catabolised at the exact same time.', 'All proteins that are to be catabolised are tagged with the peptide ubiquitin.', 'Ubiquitin is only attached to proteins that are to be synthesized, not catabolised.', 'Lysosomal enzymes provide the only mechanism for tissue protein catabolism.']\",\"question\":\"Which of the following statements about proteolysis is correct?\\n\",\"src\":\"ori_mmlu-nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}