{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d9a93347-754e-5bf4-af75-1a65f0655a9e","task_key":"default--test--2364","task_revision_id":"1","upstream_id":"2364","short_description":"Distinguish between the white and gray matter of the central nervous system.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['\\\"White matter\\\" and \\\"gray matter\\\" are terms used to describe the coloration of neurons during staining procedures.', '\\\"White matter\\\" is the nerve fiber pathways and \\\"gray matter\\\" is the collections of cell bodies.', '\\\"White matter\\\" refers to unmyelinated axons, while \\\"gray matter\\\" refers to myelinated axons.', '\\\"White matter\\\" consists of dendrites and \\\"gray matter\\\" consists of neuron cell bodies and axons.', '\\\"White matter\\\" and \\\"gray matter\\\" are both types of neurons.', '\\\"White matter\\\" is found only in the spinal cord, while \\\"gray matter\\\" is found only in the brain.', '\\\"White matter\\\" is composed of glial cells only, while \\\"gray matter\\\" consists of both neurons and glial cells.', '\\\"White matter\\\" contains the synapses and \\\"gray matter\\\" contains the neurotransmitters.', '\\\"White matter\\\" is the myelin sheath and \\\"gray matter\\\" is the axons.', '\\\"White matter\\\" is the collections of cell bodies and \\\"gray matter\\\" is the nerve fiber pathways.']\",\"question\":\"Distinguish between the white and gray matter of the central nervous system.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}