{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dd3464c6-7f45-5db7-81dc-821e268af509","task_key":"default--test--6567","task_revision_id":"1","upstream_id":"6567","short_description":"Which of the following statements about human amino acid requirements in human…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['The amino acid requirements determined for adults is assumed to be the requirement pattern for all ages.', 'The amino acid requirements determined for adults is assumed to be the requirements for maintenance for all ages.', 'The amino acid pattern of breast milk is assumed to be the requirement pattern for all children.', 'The amino acid pattern of human tissue protein is assumed to be the requirement patterns for infants and young children.']\",\"question\":\"Which of the following statements about human amino acid requirements in human nutrition is correct?\\n\",\"src\":\"ori_mmlu-nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}