{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"febd5f34-086c-5441-a6cd-07477db1bdba","task_key":"default--test--3114","task_revision_id":"1","upstream_id":"3114","short_description":"All of the following support the endosymbiotic theory that ancestors of…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Mitochondria and chloroplasts divide independently of the eukaryotic host cell by a process similar to binary fission.', 'Mitochondria and chloroplasts have ribosomes that more closely resemble those of bacteria than of eukaryotic cells.', 'Mitochondria and chloroplasts function independently from the eukaryotic host cell.', 'Mitochondria, chloroplasts, and bacteria have a single, circular chromosome without histones or proteins.']\",\"question\":\"All of the following support the endosymbiotic theory that ancestors of mitochondria and chloroplasts were once independent, free-living prokaryotes EXCEPT:\",\"src\":\"ori_mmlu-high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}