{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4141ae8f-07df-52f1-9483-37a8d5f88af2","task_key":"default--test--2870","task_revision_id":"1","upstream_id":"2870","short_description":"Nerve outgrowth from a developing neuron begins at the growth cone, located at…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['microtubules in the growth cone to undergo reversible dissociation', 'microtubules in the axon to undergo irreversible dissociation', 'microfilaments in the growth cone to undergo irreversible depolymerization', 'microfilaments in the axon to undergo reversible depolymerization', 'microfilaments in the microspike to undergo reversible depolymerization', 'microtubules in the microspike to undergo irreversible depolymerization', 'microfilaments in the axon to undergo irreversible depolymerization', 'microtubules in the microspike to undergo reversible depolymerization', 'microfilaments in the microspike to undergo irreversible depolymerization', 'microtubules in the axon to undergo reversible dissociation']\",\"question\":\"Nerve outgrowth from a developing neuron begins at the growth cone, located at the tip of the axon. Microspikes of the growth cone extend and retract in order to move the growth cone forward. Exposure of the neuron to cytochasalin B at this stage of development causes\",\"src\":\"ori_mmlu-college_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}