{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b2c90689-0683-5859-9afd-8ba86a6b877f","task_key":"default--test--2284","task_revision_id":"1","upstream_id":"2284","short_description":"Which sentence most accurately describes how neurons communicate?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Messages are transmitted from neuron to neuron via sound waves.', 'Neurons send messages up the spinal cord to the cerebral cortex through neural reflexes.', 'Electricity passes between neurons, which carries messages between one neuron and another.', 'Neurons transmit information through the exchange of genetic material.', 'Neurons communicate through vibrations in the cellular membrane.', 'Neurons communicate through a combination of electrical and chemical signals, but without any physical contact.', 'Neurons communicate by emitting light signals that are received by neighboring neurons.', 'Neurons communicate through physical contact between dendrites of one cell and the next cell.', 'Neurons send messages to each other through the circulatory system.', 'Chemicals travel from one neuron to another, influencing whether a neuron will fire or not.']\",\"question\":\"Which sentence most accurately describes how neurons communicate?\",\"src\":\"ori_mmlu-high_school_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}