{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"123b14fc-2b5b-5b83-9a70-02d9f833a54b","task_key":"default--test--6643","task_revision_id":"1","upstream_id":"6643","short_description":"What is the most common way for a virus to kill a cell?","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Directly destroys the cell nucleus', 'Fragments cellular DNA', \\\"Depletes the cell's energy resources\\\", \\\"Changes the cell's genetic code\\\", 'Dissolves the cellular membrane', 'Prevents cell division by blocking mitosis', 'Introduces toxic substances into the cell', 'Causes the cell to explode through rapid replication', 'Induces apoptosis via caspases', 'Totally blocks cellular transcription']\",\"question\":\"What is the most common way for a virus to kill a cell?\",\"src\":\"ori_mmlu-virology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}