{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bfc2eebe-0212-560b-98d9-2ff192bbca2c","task_key":"default--test--3235","task_revision_id":"1","upstream_id":"3235","short_description":"From a patch of garden peas, a random sampling of 13 plants is made. Their…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Mean: 174 cm, Median: 180 cm, Mode: 180-185, Variance: 100.33 cm^2, Standard deviation: 10.02 cm', 'Mean: 171 cm, Median: 170 cm, Mode: 168-173, Variance: 80.33 cm^2, Standard deviation: 8.96 cm', 'Mean: 176 cm, Median: 173 cm, Mode: 174-179, Variance: 88.33 cm^2, Standard deviation: 9.40 cm', 'Mean: 175 cm, Median: 178 cm, Mode: 177-181, Variance: 95.33 cm^2, Standard deviation: 9.80 cm', 'Mean: 169 cm, Median: 172 cm, Mode: 167-172, Variance: 76.33 cm^2, Standard deviation: 8.73 cm', 'Mean: 170 cm, Median: 175 cm, Mode: 160-165, Variance: 85.33 cm^2, Standard deviation: 9.24 cm', 'Mean: 178 cm, Median: 179 cm, Mode: 177-182, Variance: 105.33 cm^2, Standard deviation: 10.26 cm', 'Mean: 172 cm, Median: 177 cm, Mode: 175-180, Variance: 90.33 cm^2, Standard deviation: 9.50 cm', 'Mean: 177 cm, Median: 174 cm, Mode: 170-175, Variance: 82.33 cm^2, Standard deviation: 9.07 cm', 'Mean: 173 cm, Median: 176 cm, Mode: 176-180, Variance: 92.33 cm^2, Standard deviation: 9.61 cm']\",\"question\":\"From a patch of garden peas, a random sampling of 13 plants is made. Their height in centimetres is as follows: 161183177157181176180 162163174179169187 Calculate: (a)themean;(b) the median;(c) the mode; (d)thevariance;(e) the standard deviation.\",\"src\":\"stemez-Genetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}