{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"90785a2a-a143-5688-b236-1f024d40c965","task_key":"default--test--3439","task_revision_id":"1","upstream_id":"3439","short_description":"A researcher is experimenting with nerve transmission using neurons from a giant…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The frequency of the action potential increases.', 'The strength of the action potential decreases.', 'The axon becomes depolarized to +50 mV.', 'The axon becomes depolarized to –30 mV.', 'The strength of the action potential becomes greater.', 'The axon becomes hyperpolarized to –100 mV.', 'The frequency of the action potential decreases.', 'The axon becomes hyperpolarized to –90 mV.', 'The axon becomes hyperpolarized to –50 mV.', 'The axon remains at rest at –70 mV despite the stimuli.']\",\"question\":\"A researcher is experimenting with nerve transmission using neurons from a giant squid. At the beginning of the experiment, the axon is at rest and has a threshold measured at –70 mV at 37oC. The axon receives one stimulus that triggers one action potential in the axon. Subsequent stimuli are much stronger. Which of the following statements explains what happens when several strong stimuli are experienced by the axon?\",\"src\":\"ori_mmlu-high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}