{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"905c1fcc-9f14-5187-8af0-443dc797d222","task_key":"default--test--6910","task_revision_id":"1","upstream_id":"6910","short_description":"Suppose that the Durbin Watson test is applied to a regression containing two…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Residuals appear to be negatively autocorrelated', 'There is a strong linear relationship between the variables', 'The regression model is incorrectly specified', 'The residuals are heteroscedastic', 'Residuals appear not to be autocorrelated', 'The residuals are homoscedastic', 'There is no relationship between the variables', 'Residuals appear to be positively autocorrelated', 'Residuals appear to be perfectly autocorrelated', 'The test result is inconclusive']\",\"question\":\"Suppose that the Durbin Watson test is applied to a regression containing two explanatory variables plus a constant with 50 data points. The test statistic takes a value of 1.53. What is the appropriate conclusion?\",\"src\":\"ori_mmlu-econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}