{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"56ea0f05-4318-5c26-9676-bfe7336cacb6","task_key":"default--test--3404","task_revision_id":"1","upstream_id":"3404","short_description":"Assume a population of garden peas in genetic equilibrium in which the…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['0.54FF + 0.12Ff + 0.34ff', '0.42FF + 0.36Ff + 0.22ff', '0.30FF + 0.40Ff + 0.30ff', '0.48FF + 0.24Ff + 0.28ff', '0.36FF + 0.48Ff + 0.16ff', '0.57FF + 0.06Ff + 0.37ff', '0.25FF + 0.50Ff + 0.25ff', '0.6FF + 0.2Ff + 0.2ff', '0.64FF + 0.16Ff + 0.20ff', '0.49FF + 0.02Ff + 0.49ff']\",\"question\":\"Assume a population of garden peas in genetic equilibrium in which the frequencies of the genes for full pods (F) and constricted pods (f) are 0.6 and 0.4, respectively. If this population is allowed only to reproduce by self-fertilization for three generations, what will be the distribution of the three genotypes by the third generation of self-fertilization?\",\"src\":\"stemez-Genetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}