{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d9a373ee-d9ff-5d3b-b0cf-11d7844f261c","task_key":"default--test--7315","task_revision_id":"1","upstream_id":"7315","short_description":"Which of the following statements are true concerning the Box-Jenkins approach…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['(iii) and (iv) only', '(i) and (iii) only', '(i), (iii), and (iv) only', '(i), (ii), and (iii) only', '(ii) and (iii) only', '(i) and (iv) only', '(i), (ii), (iii), and (iv)', '(ii) and (iv) only', '(ii), (iii), and (iv) only', '(i) and (ii) only']\",\"question\":\"Which of the following statements are true concerning the Box-Jenkins approach to diagnostic testing for ARMA models?\\n\\n(i) The tests will show whether the identified model is either too large or too small\\n\\n(ii) The tests involve checking the model residuals for autocorrelation, heteroscedasticity, and non-normality\\n\\n(iii) If the model suggested at the identification stage is appropriate, the acf and pacf for the residuals should show no additional structure\\n\\n(iv) If the model suggested at the identification stage is appropriate, the coefficients on the additional variables under the overfitting approach will be statistically insignificant\",\"src\":\"ori_mmlu-econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}