{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8739a2ce-f9d8-57fe-a074-4e431054ec81","task_key":"default--test--3003","task_revision_id":"1","upstream_id":"3003","short_description":"In an animal with a haploid number of 10, how many chromosomes are present in…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['a) 20 chromatids, b) 10 chromosomes, c) 20 chromosomes, d) 10 chromatids', 'a) 10 chromosomes, b) 10 chromatids, c) 10 chromatids, d) 10 chromosomes', 'a) 20 chromosomes, b) 10 chromosomes, c) 20 chromatids, d) 10 chromatids', 'a) 20 chromatids, b) 20 chromosomes, c) 10 chromatids, d) 20 chromosomes', 'a) 10 chromatids, b) 20 chromatids, c) 20 chromosomes, d) 10 chromosomes', 'a) 10 chromosomes, b) 20 chromosomes, c) 20 chromatids, d) 10 chromatids', 'a) 20 chromosomes, b) 10 chromatids, c) 20 chromatids, d) 10 chromosomes', 'a) 10 chromatids, b) 20 chromosomes, c) 10 chromosomes, d) 20 chromatids', 'a) 10 chromosomes, b) 10 chromosomes, c) 20 chromatids, d) 20 chromatids', 'a) 20 chromosomes, b) 20 chromatids, c) 10 chromosomes, d) 20 chromatids']\",\"question\":\"In an animal with a haploid number of 10, how many chromosomes are present in a)aspermatogonium? b) In the first polar body? c) In the second polar body? d) In the secondaryoocyte? Assume, that the animal is diploid.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}