{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ade8c50d-2da0-56bd-9e3b-99def0123dcc","task_key":"default--test--3134","task_revision_id":"1","upstream_id":"3134","short_description":"The earthworm has a central nerve cord running along the entire length of the…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The earthworm can regenerate its nerve cord quickly.', 'The earthworm has a backup nerve cord that takes over when the main one is severed.', 'The earthworm uses chemical signals to communicate and coordinate movement between segments.', \\\"The earthworm's body movements are controlled by a fluid-filled hydraulic system independent of the nerve cord.\\\", 'The earthworm has a centralized brain controlling all movements.', \\\"The earthworm's movements are not controlled by its nervous system.\\\", 'The earthworm has more than one neural center controlling and coordinating its activities.', 'The earthworm’s skin is sensitive to touch, allowing for movement without a nerve cord.']\",\"question\":\"The earthworm has a central nerve cord running along the entire length of the body. When an earthworm is cut into several parts, severing its nerve cord in the process, each part will go on crawling around for some time. How can each fragment carry out crawling movement even after the nerve cord is severed?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}