{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"afc50ba7-6092-5e6c-8965-6036edbb4d52","task_key":"default--test--2987","task_revision_id":"1","upstream_id":"2987","short_description":"Although mutations occur at a regular and predictable rate, which of the…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Some mutations produce alleles that are recessive and may not be expressed.', 'Some undesirable phenotypic traits may be prevented from reproducing.', 'Some mutations cause such drastic phenotypic changes that they are removed from the gene pool.', 'The predictable rate of mutation results in ongoing variability in a gene pool.']\",\"question\":\"Although mutations occur at a regular and predictable rate, which of the following statements is the LEAST likely reason the frequency of mutation appears to be low?\",\"src\":\"ori_mmlu-high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}