{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6f1c8311-9470-5f97-9128-e91f93276071","task_key":"default--test--3006","task_revision_id":"1","upstream_id":"3006","short_description":"Explain how the planarian changes its body shape.","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['By extending and retracting spines along its body', 'Through the use of cilia on its underside for movement and shape alteration', 'By secreting a mucus layer to change body contours', 'By absorbing water and expanding', 'By coordinated contraction and relaxation of circular, longitudinal, and dorsoventral muscles, the body shape of a planarian can be varied.', 'By shifting the distribution of body fluids to different segments', 'By changing the thickness of its skin', 'By rapid cell division and growth in specific body regions', 'By inflating air sacs within its body', 'By altering its genetic structure']\",\"question\":\"Explain how the planarian changes its body shape.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}