{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"72759625-57e9-5a25-9875-0e6deb351e07","task_key":"default--test--3323","task_revision_id":"1","upstream_id":"3323","short_description":"Which of the following statements is correct?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Smaller DNA fragments migrate more rapidly than do larger DNA fragments on gel electrophoresis.', 'Germinating seeds use less oxygen than do nongerminating seeds.', 'The rate of transpiration decreases with an increase in air movement.', 'The rate of photosynthesis decreases with an increase in light intensity.', 'Non-germinating seeds require more water than germinating seeds.', 'Larger DNA fragments migrate more rapidly than do smaller DNA fragments on gel electrophoresis.', 'Water flows from hypertonic to hypotonic.', 'The rate of respiration decreases with an increase in temperature.']\",\"question\":\"Which of the following statements is correct?\",\"src\":\"ori_mmlu-high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}