{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"56f4c899-ad8c-5a1f-9d0d-2d875a486fe0","task_key":"default--test--3089","task_revision_id":"1","upstream_id":"3089","short_description":"Define the terms \\textquotedblleftrange\\textquotedblright and…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Center of origin is the region where a species has the highest rate of reproduction, while the range is the area where it has the lowest survival rate.', 'Range is that portion of earth in which a species is found and center of origin is the place where it originated.', 'Center of origin is the place where a species is most abundant.', 'Range is the maximum distance a species can migrate, while the center of origin is the location of its greatest genetic diversity.', 'Range and center of origin are the same.', \\\"Range is the geographical area where a species can't survive.\\\", 'Center of origin refers to the primary area a species is used for commercial purposes, and range is the secondary area where it can be found.', 'Center of origin is the area where a species was first recorded in scientific literature, and range is the set of ecological niches it occupies.', \\\"Range is the climatic conditions suitable for a species' survival, and the center of origin is the central point within this range.\\\", 'Range is the area where a species is artificially introduced, and the center of origin is the historical site of its discovery.']\",\"question\":\"Define the terms \\\\textquotedblleftrange\\\\textquotedblright and \\\\textquotedblleftcenter of origin.\\\\textquotedblright\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}