{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3f6573b1-4821-5d1b-a1aa-3f5417e0e871","task_key":"default--test--3162","task_revision_id":"1","upstream_id":"3162","short_description":"The structure of ATP synthase in the plasma membranes of bacteria is nearly…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The structure of ATP synthase is not evolutionarily significant.', 'Mitochondria are derived from ancient aerobic bacteria, and chloroplasts are derived from ancient photosynthetic bacteria.', 'Prokaryotic cells are derived from eukaryotic cells.', 'Eukaryotic and prokaryotic cells share a common ancestor.', 'The structure of ATP synthase evolved independently in eukaryotes and prokaryotes.', 'ATP synthase in mitochondria and chloroplasts was borrowed from bacteria through horizontal gene transfer.', 'Mitochondria and chloroplasts escaped from eukaryotic cells and formed aerobic and photosynthetic prokaryotes.', 'The structure of ATP synthase in eukaryotes and prokaryotes is an example of divergent evolution.', 'Mitochondria and chloroplasts are remnants of ancient viruses that infected eukaryotic cells.', 'The similarity of ATP synthase in bacteria, mitochondria, and chloroplasts is an example of convergent evolution.']\",\"question\":\"The structure of ATP synthase in the plasma membranes of bacteria is nearly identical to that in the mitochondria and chloroplasts of eukaryotic cells. This similarity best supports which of the following hypotheses?\",\"src\":\"ori_mmlu-high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}