{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"45146871-2170-5e72-834d-94eccea93187","task_key":"default--test--3493","task_revision_id":"1","upstream_id":"3493","short_description":"Apoptosis, which is programmed cell death, is a necessary process in living…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['It occurs randomly.', 'A particular cell dies when it is no longer needed by the organism.', 'A cell carries out apoptosis when too many mutations have accumulated.', 'Plant cells carry out apoptosis as a defense measure in cells that have been infected by parasites.']\",\"question\":\"Apoptosis, which is programmed cell death, is a necessary process in living organisms. Which of the following is NOT correct about apoptosis?\",\"src\":\"ori_mmlu-high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}