{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cee1643b-9b6e-5252-becd-706f2ca47e69","task_key":"all--test--cee1643b-9b6e-5252-becd-706f2ca47e69","task_revision_id":"1","upstream_id":"","short_description":"Which sentence most accurately describes how neurons communicate?","config":"all","split":"test","body":"{\"choices\":\"['Neurons communicate through physical contact between dendrites of one cell and the next cell.', 'Electricity passes between neurons, which carries messages between one neuron and another.', 'Chemicals travel from one neuron to another, influencing whether a neuron will fire or not.', 'Neurons send messages up the spinal cord to the cerebral cortex through neural reflexes.']\",\"question\":\"Which sentence most accurately describes how neurons communicate?\",\"subject\":\"high_school_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}