{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"73ec3d44-4f41-5e52-988d-e42c18a00149","task_key":"default--test--7656","task_revision_id":"1","upstream_id":"7656","short_description":"Which of the following is a disadvantage of the fixed effects approach to…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['The approach may not be valid if the composite error term is correlated with one or more of the explanatory variables', 'The approach may not be valid if the dependent variable is correlated with one or more of the explanatory variables', 'The approach can only capture temporal variation and not cross-sectional heterogeneity in the dependent variable', 'The model is likely to be easy to estimate', 'The model cannot capture individual-specific effects', 'The model is likely to be technical to estimate', 'The fixed effects approach can handle large amounts of data without any loss of degrees of freedom', 'The fixed effects approach can only capture cross-sectional heterogeneity and not temporal variation in the dependent variable.', 'The fixed effects approach cannot handle time-invariant variables', 'The number of parameters to estimate may be large, resulting in a loss of degrees of freedom']\",\"question\":\"Which of the following is a disadvantage of the fixed effects approach to estimating a panel model?\",\"src\":\"ori_mmlu-econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}