{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"adc890b8-87de-53be-9d95-cff330a870e4","task_key":"default--test--3062","task_revision_id":"1","upstream_id":"3062","short_description":"Which of the following is the symplastic pathway for the movement of sucrose…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Bundle sheath, companion cell, phloem parenchyma, fibers', 'Phloem parenchyma, bundle sheath, fibers, companion cell', 'Bundle sheath, phloem parenchyma, companion cell, sieve tube', 'Bundle sheath, fibers, companion cell, sieve tube', 'Fibers, bundle sheath, companion cell, sieve tube', 'Fibers, phloem parenchyma, bundle sheath, tracheids', 'Phloem parenchyma, fibers, bundle sheath, tracheids', 'Companion cells, phloem parenchyma, fibers, sieve tube', 'Fibers, phloem parenchyma, companion cell, sieve tube', 'Companion cell, bundle sheath, fibers, sieve tube']\",\"question\":\"Which of the following is the symplastic pathway for the movement of sucrose from the site of photosynthesis in mesophyll cells into the phloem?\",\"src\":\"ori_mmlu-college_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}