{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9aedade0-d6cb-59ff-bb75-4f4e7e75add0","task_key":"default--test--7510","task_revision_id":"1","upstream_id":"7510","short_description":"Which of the following statements are true concerning a comparison between…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['(ii), (iii), and (iv) only', '(iii) and (iv) only', '(i), (ii), (iii), and (iv)', '(i), (iii), and (iv) only', '(ii) and (iii) only', '(i), (ii), and (iii) only', '(i) and (ii) only', '(i) and (iii) only', '(ii) and (iv) only', '(i) and (iv) only']\",\"question\":\"Which of the following statements are true concerning a comparison between ARCH(q) and GARCH(1,1) models?\\n\\ni) The ARCH(q) model is likely to be the more parsimonious\\n\\n\\nii) The ARCH(q) model is the more likely to violate non-negativity constraints\\n\\n\\niii) The ARCH(q) model can allow for an infinite number of previous lags of squared\\n\\nreturns to affect the current conditional variance\\n\\n\\niv) The GARCH(1,1) model will usually be sufficient to capture all of the dependence\\n\\nin the conditional variance\",\"src\":\"ori_mmlu-econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}