{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"990549cd-5137-543b-b9a3-8abfb56fc9f6","task_key":"default--test--2922","task_revision_id":"1","upstream_id":"2922","short_description":"On Andros Islands in the Bahamas, populations of mosquito fish, Gambusia hubbsi,…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Reproductive isolation was a result of behavioral changes.', 'Geographic isolation resulted in sympatric speciation.', 'Allopatric isolation brought about reproductive isolation.', 'Allopatric isolation did not affect reproductive isolation.', 'Reproductive isolation caused geographic isolation.', 'Sympatric isolation resulted in geographic isolation.', 'The body shapes of the fish are the result of genetic drift.', 'Sympatric isolation brought about reproductive isolation.', 'Reproductive isolation was not complete.', 'The evolution of different body shapes is an example of coevolution.']\",\"question\":\"On Andros Islands in the Bahamas, populations of mosquito fish, Gambusia hubbsi, colonized a series of ponds. These ponds are no longer connected. However, the environments are very similar except that some ponds contain predatory fish, while others do not. In high predation ponds, selection has favored the evolution of a body shape that enables rapid bursts of speed. In low predation ponds, another body type is favored—one that is well-suited to swim for long periods of time.\",\"src\":\"ori_mmlu-high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}