{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"106784aa-f15c-5b39-b8f8-ceede38a2af1","task_key":"default--test--7065","task_revision_id":"1","upstream_id":"7065","short_description":"What is the most important disadvantage of the diagonal VECH approach to…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['The diagonal VECH model does not provide accurate forecasts', 'The diagonal VECH model is hard to interpret intuitively', 'The diagonal VECH model contains too many parameters', 'The BEKK model does not have the flexibility of the diagonal VECH model', 'The BEKK model does not ensure a positive-definite variance-covariance matrix', 'The diagonal VECH model does not allow for multivariate time series analysis', 'The diagonal VECH model is not suitable for large datasets', 'The BEKK model reduces the dimensionality problem that arises when a number of series are modelled together.', 'The BEKK model is more computationally intensive than the diagonal VECH model', 'The diagonal VECH model does not ensure a positive-definite variance-covariance matrix']\",\"question\":\"What is the most important disadvantage of the diagonal VECH approach to building multivariate GARCH models that is overcome by the BEKK formulation?\",\"src\":\"ori_mmlu-econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}