{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7e74b54f-9dd5-5fa7-8489-fd00d9f57d73","task_key":"default--test--2836","task_revision_id":"1","upstream_id":"2836","short_description":"In a given population of 610 individuals, the gene frequencies of the L^M and…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['238 M, 292 MN, 80 N', '230 M, 295 MN, 85 N', '260 M, 260 MN, 90 N', '220 M, 300 MN, 90 N', '225 M, 310 MN, 75 N', '255 M, 270 MN, 85 N', '245 M, 275 MN, 90 N', '235 M, 287 MN, 88 N', '250 M, 280 MN, 80 N', '240 M, 290 MN, 80 N']\",\"question\":\"In a given population of 610 individuals, the gene frequencies of the L^M and L^N alleles were found to be .62 and .38, respectively. Calculate the number of individuals with M, MN, and N type blood.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}