{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"286c1e12-f4fc-5eb7-a86a-a9dad1d93efa","task_key":"default--test--3351","task_revision_id":"1","upstream_id":"3351","short_description":"Research advancements over the past years have greatly changedour views on…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['cdc mutants have no effect on our understanding of the cell cycle', 'cdc mutants helped identify the role of physical cell size in dictating the progression of the cell cycle', 'cdc mutants disproved the model of the cell cycle', 'cdc mutants revealed that the cell cycle is entirely random and not regulated', 'cdc mutants led to the establishment of a model of the cell cycle as a complex biochemical pathway', 'cdc mutants hindered the understanding of the cell cycle', 'cdc mutants have been used to demonstrate that the cell cycle can proceed in the absence of DNA replication', 'cdc mutants suggested that the cell cycle is a simple, linear process without checkpoints', 'cdc mutants showed that the cell cycle is independent of genetic control', 'cdc mutants have helped confirm that environmental factors are the sole determinants of the cell cycle']\",\"question\":\"Research advancements over the past years have greatly changedour views on mitosis and the cell cycle in general. Of particular importance has been the discovery and characterizationof several mutants in budding and fission yeastwhich arrest cell growth at defined points in the cell cycle. How has the study of thesecdcmutants enhanced our understandingof the cell cycle?\",\"src\":\"stemez-Genetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}