{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f28d0710-c169-5f0d-9d98-15ef3109f1b5","task_key":"default--test--6198","task_revision_id":"1","upstream_id":"6198","short_description":"Which of the following statements about methods of evaluating protein quality in…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['The Biological Value (BV) of a protein does not affect its quality in human nutrition.', 'The Digestible Indispensable Amino Acid Score (DIAAS) is not a reliable method for assessing protein quality for human nutrition.', 'The growing rat is a good model for assessing protein quality in human nutrition.', 'The use of rats in protein quality tests overestimates the quality of dietary proteins for human nutrition.', 'Animal growth assays underestimate the quality of dietary proteins for human nutrition', 'The Chemical Score (CS) is the most accurate method for assessing protein quality in human nutrition.', 'The rat net protein-utilisation assay, (NPU), is the best method of assessing protein quality for human nutrition.', 'The Protein Digestibility Corrected Amino Acid Score (PDCAAS) is the worst method for assessing protein quality for human nutrition.', 'The Human Amino Acid Requirement Pattern (HAARP) is the most reliable method for assessing protein quality for human nutrition.', 'The rat protein efficiency ratio assay, (PER), is a good method of assessing protein quality for human nutrition.']\",\"question\":\"Which of the following statements about methods of evaluating protein quality in human nutrition is correct?\\n\",\"src\":\"ori_mmlu-nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}