{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"03c4edef-a9d0-596e-a317-c3af1f487520","task_key":"default--test--2891","task_revision_id":"1","upstream_id":"2891","short_description":"What is meant by the term muscle fatigue?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Muscle fatigue is the result of a decrease in muscle temperature during exercise.', 'Muscle fatigue is due to lack of physical exercise.', 'Muscle fatigue is a result of excessive calcium buildup in the muscle tissue.', 'Muscle fatigue is due to overhydration.', 'Muscle fatigue is due to a permanent loss of muscle fibers.', 'Muscle fatigue is due to lack of protein in diet.', 'Muscle fatigue is solely caused by dehydration.', \\\"Muscle fatigue is caused by the muscles' overuse of vitamins and minerals.\\\", 'Muscle fatigue is due to an accumulation of lactic acid, depletion of stored energy reserves, and breakdown in neuromuscular junction transmission.', 'Muscle fatigue is a consequence of an overabundance of oxygen in the muscles.']\",\"question\":\"What is meant by the term muscle fatigue?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}