{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0efd5183-543d-5df4-a740-a073bac8c8e3","task_key":"default--test--3293","task_revision_id":"1","upstream_id":"3293","short_description":"Colchicineblocks mitosis. What does this reveal about the mitoticprocess?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Spindle fibers are not composed of microtubules', 'Nuclear envelope does not break down during mitosis', 'Chromosomes do not condense during mitosis', 'Microtubules are not involved in mitosis', 'Colchicine increases the stability of microtubules', 'Microtubules shorten by adding tubulin subunits', 'Microtubules are the major component of spindle fibers', 'Colchicine enhances mitosis', 'Colchicine prevents the duplication of DNA during mitosis', 'Mitosis does not require energy in the form of ATP']\",\"question\":\"Colchicineblocks mitosis. What does this reveal about the mitoticprocess?\",\"src\":\"stemez-Genetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}