{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"41127167-2937-540d-b96b-767243a0d82c","task_key":"default--test--3255","task_revision_id":"1","upstream_id":"3255","short_description":"If mating is observed to occur freely between organisms of twodifferent…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Only if the offspring can also interbreed successfully.', 'No, successful interbreeding in the laboratory must also be complemented by ecological, behavioral, and morphological studies to confirm they are the same species.', 'It depends on whether the organisms can interbreed in a controlled environment other than a laboratory.', 'No, successful interbreeding in the laboratory does not offer enough evidence that two populations must be of the same species.', 'It depends on the type of organisms being tested.', 'No, unless the interbreeding also occurs frequently in their natural habitat.', 'Yes, successful interbreeding in the laboratory is sufficient proof of the same species.', 'Only if the organisms share identical genetic markers.', 'Yes, if the offspring show traits that are a mix of both parent populations.', 'Yes, as long as the offspring are not sterile.']\",\"question\":\"If mating is observed to occur freely between organisms of twodifferent populations in the laboratory, and the cross producesviable offspring, can you assume that the two populationsbelong to the same species?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}