{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c1d3c1a5-65a8-52fb-8e4a-2ab16187bcb0","task_key":"default--test--2805","task_revision_id":"1","upstream_id":"2805","short_description":"The light reactions of photosynthesis supply the Calvin cycle with which of the…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['CO2 released by the light-dependent reactions provides the raw material for the Calvin cycle.', 'The light reactions provide oxygen for the light-independent reactions.', 'Water entering the plant through the roots provides hydrogen directly to the Calvin cycle.', 'ATP and NADPH provide the power and raw materials for the Calvin cycle.', 'The light reactions provide nitrogen to the Calvin cycle for protein synthesis.', 'Glucose and fructose are supplied to the Calvin cycle by the light reactions.', 'The light reactions supply the Calvin cycle with sunlight directly.', 'ATP and NADPH are broken down in the light reactions to supply the Calvin cycle with energy.', 'The light reactions provide carbon dioxide for the light-independent reactions.', 'The light reactions supply the Calvin cycle with water and oxygen.']\",\"question\":\"The light reactions of photosynthesis supply the Calvin cycle with which of the following?\",\"src\":\"ori_mmlu-high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}