{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7a7841bc-56a8-5815-92d7-c68808cfbe9a","task_key":"default--test--6568","task_revision_id":"1","upstream_id":"6568","short_description":"Which of the following statements about human amino acid requirements in human…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['The amino acid requirements determined for adults is assumed to be the requirement pattern for all ages.', 'The amino acid pattern of breast milk is assumed to be the requirement pattern for all children.', 'The amino acid requirements determined for infants is assumed to be the requirements for maintenance for all ages.', 'The amino acid pattern of animal protein is assumed to be the requirement patterns for adults.', 'The amino acid pattern of human tissue protein is assumed to be the requirement patterns for all ages.', 'The amino acid requirements determined for adults is assumed to be the requirements for maintenance for all ages.', 'The amino acid pattern of human tissue protein is assumed to be the requirement patterns for infants and young children.', 'The amino acid pattern of breast milk is assumed to be the requirement pattern for all adults.', 'The amino acid requirements determined for the elderly is assumed to be the requirements for maintenance for all ages.', 'The amino acid requirements determined for children is assumed to be the requirement pattern for all ages.']\",\"question\":\"Which of the following statements about human amino acid requirements in human nutrition is correct?\\n\",\"src\":\"ori_mmlu-nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}