{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7cb89359-70d4-50f2-90b1-97ef52fd6694","task_key":"default--test--3013","task_revision_id":"1","upstream_id":"3013","short_description":"If all the chemical components found in a living cell were to beput together in…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Living things are characterized only by their complexity and organization, without the need for energy consumption or reproduction.', 'Living things are characterized by a specific, complex organization, the ability to consume energy, movement, response to physical or chemical changes, growth, reproduction, and adaptability.', 'Living things are characterized only by their growth.', 'Living things are characterized by their ability to maintain homeostasis, without the need for growth, reproduction, or adaptability.', 'Living things are characterized by their ability to evolve over generations but not by individual growth or energy consumption.', 'Living things are characterized by their ability to respond to changes and growth, but not by reproduction or energy consumption.', 'Living things are characterized only by their ability to consume energy.', 'Living things are characterized only by their movement.', 'Living things are characterized only by their adaptability to changes.', 'Living things are characterized only by their ability to reproduce.']\",\"question\":\"If all the chemical components found in a living cell were to beput together in the right proportion, the mixture would not functionas living matter. What characteristics would enable usto consider something living?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}