{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"37eb1663-8952-52fb-a6fd-b9f08164e7df","task_key":"default--test--6386","task_revision_id":"1","upstream_id":"6386","short_description":"Which of the following statements about proteolysis is correct?","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Ubiquitin is only attached to proteins that are to be synthesized, not catabolised.', 'Proteolysis is the process of protein synthesis, not breakdown.', 'Proteolysis only occurs in animal cells.', 'All proteins that are to be catabolised are tagged with the peptide ubiquitin.', 'Lysosomal enzymes provide the only mechanism for tissue protein catabolism.', 'Proteolysis can only occur in the presence of light.', 'Proteolysis does not involve enzymatic processes.', 'The rate of tissue protein catabolism is more or less constant throughout the day.', 'All tissue proteins undergo catabolism at more or less the same rate.', 'All proteins are catabolised at the exact same time.']\",\"question\":\"Which of the following statements about proteolysis is correct?\\n \",\"src\":\"ori_mmlu-nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}