{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ae0fb788-d76e-5f53-93e4-3b88d4bd5f81","task_key":"default--test--2809","task_revision_id":"1","upstream_id":"2809","short_description":"Which of the following statements is NOT correct about apoptosis?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Apoptosis, a special type of cell division, requires multiple cell signaling.', 'The fact that apoptosis is widespread across several kingdoms is evidence that it evolved early in the evolution of eukaryotes.', 'Apoptosis plays a crucial role in the development of fingers in embryonic development.', 'Apoptosis prevents an aging and dying cell from damaging neighboring cells.']\",\"question\":\"Which of the following statements is NOT correct about apoptosis?\",\"src\":\"ori_mmlu-high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}