{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"aa528161-4613-52b0-9adb-ff48d23b296b","task_key":"default--test--7250","task_revision_id":"1","upstream_id":"7250","short_description":"Which of the following are advantages of the VAR approach to modelling the…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['(i), (ii), and (iii) only', '(i), (iii), and (iv) only', '(ii), (iii), and (iv) only', '(i) and (iv) only', '(ii) and (iii) only', '(i) and (ii) only', '(ii) and (iv) only', '(iii) and (iv) only', '(i), (ii), (iii), and (iv)', '(i) and (iii) only']\",\"question\":\"Which of the following are advantages of the VAR approach to modelling the relationship between variables relative to the estimation of full structural models?\\n\\ni) VARs receive strong motivation from financial and economic theory\\n\\n\\nii) VARs in their reduced forms can be used easily to produce time-series forecasts\\n\\n\\niii) VAR models are typically highly parsimonious\\n\\n\\niv) OLS can be applied separately to each equation in a reduced form VAR\",\"src\":\"ori_mmlu-econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}