{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"004a7bba-7b1b-53ac-bb67-f20f72022596","task_key":"default--test--3004","task_revision_id":"1","upstream_id":"3004","short_description":"Are the daughter nuclei formed during cleavage exactly equivalent , or is there…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Partial segregation of genetic potentialities during cleavage', 'Partial segregation of genetic potentialities, influenced by environmental factors during cleavage', 'Random parceling out of genetic potentialities independent of cleavage', 'Segregation of genetic potentialities occurs, but only in specific cell lineages', 'Segregation of genetic potentialities only in later stages', 'Segregation of genetic potentialities with bias toward cellular location', 'No segregation of genetic potentialities during cleavage', 'Segregation of genetic potentialities based on maternal and paternal origin', 'Segregation of genetic potentialities during cleavage', 'Equal segregation of genetic potentialities, but differential activation during cleavage']\",\"question\":\"Are the daughter nuclei formed during cleavage exactly equivalent , or is there some sort of parceling out of potentialities during cleavage?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}