{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7dbeb789-304d-548e-97ae-d7397114c0d6","task_key":"default--test--2890","task_revision_id":"1","upstream_id":"2890","short_description":"In peas, tall (D) is dominant to dwarf (d), yellow (G) is dominant to green (g),…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['1/4', '3/16', '1/64', '1/2', '1/16', '1/8', '1/3', '3/32', '1/32', '1/128']\",\"question\":\"In peas, tall (D) is dominant to dwarf (d), yellow (G) is dominant to green (g), and round (W) is dominant to wrinkled (w). What fraction of the offspring of this cross would be homozygous recessive in all gene pairs? GgDdww×GgddWw\",\"src\":\"stemez-Genetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}