{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"57f1aa38-92fc-536a-ac8c-b0c669b85eb0","task_key":"default--test--7653","task_revision_id":"1","upstream_id":"7653","short_description":"Which of the following statements is INCORRECT concerning the classical…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['If the null hypothesis is rejected, the alternative is accepted', 'The null hypothesis is the statement being tested while the alternative encompasses the remaining outcomes of interest', 'The test of significance and confidence interval approaches will always give the same conclusions', 'Hypothesis tests are used to make inferences about the population parameters.']\",\"question\":\"Which of the following statements is INCORRECT concerning the classical hypothesis testing framework?\",\"src\":\"ori_mmlu-econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}