{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2a0352c2-be9e-510f-8f59-9555972fbee6","task_key":"default--test--3174","task_revision_id":"1","upstream_id":"3174","short_description":"Supposing that theclonalselection theory is correct, how canan organism…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Through vertical gene transfer from parent to offspring', 'Through random assortment of genes during meiosis', 'Through peptide bond formation errors during translation', 'Through genetic mutation only', 'Through transcriptional errors in RNA processing', 'Through symbiotic gene acquisition from other organisms', 'Through gene duplication', 'Through germline hypothesis, somatic mutation theory, and the rearrangement theory', 'Through direct uptake and incorporation of environmental DNA', 'Through horizontal gene transfer']\",\"question\":\"Supposing that theclonalselection theory is correct, how canan organism genetically make such diverse proteins?\",\"src\":\"stemez-Genetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}