{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"557ee921-2a14-5f16-8d09-37e01dbd763c","task_key":"default--test--8008","task_revision_id":"1","upstream_id":"8008","short_description":"Which of the following is not true with regard to contingency tables for…","config":"default","split":"test","body":"{\"category\":\"math\",\"options\":\"['Expected frequencies in each cell should be at least 5, and to achieve this, one sometimes combines categories for one or the other or both of the variables.', 'Expected frequencies should be whole numbers.', 'Contingency tables are not required for chi-square tests for independence.', 'Observed frequencies should be whole numbers.', 'The categories are not numerical for either variable.']\",\"question\":\"Which of the following is not true with regard to contingency tables for chi-square tests for independence?\",\"src\":\"ori_mmlu-high_school_statistics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}