{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2fddcd2c-f224-51c0-a866-2d57e9b3d7fa","task_key":"default--test--3445","task_revision_id":"1","upstream_id":"3445","short_description":"The ability of the brain to detect differences in stimulus intensity is best…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The number of synapses crossed', 'The speed of the action potential', 'The amplitude of the action potential', 'The number of neurons activated', 'The refractory period of the neuron', 'The number of action potentials per second', 'The duration of the action potential', \\\"The permeability of the neuron's membrane\\\", 'The resting potential of the neuron', 'The threshold potential']\",\"question\":\"The ability of the brain to detect differences in stimulus intensity is best explained by the fact that which of the following varies with the stimulus intensity?\",\"src\":\"ori_mmlu-college_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}