{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e8998daa-d29a-56dc-a96a-0fd6d71f5f7f","task_key":"default--test--7375","task_revision_id":"1","upstream_id":"7375","short_description":"Consider the following equation and determine the class of model that it best…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['A pure time series model', 'A difference-in-differences model', 'A random effects model', 'A pooled OLS model', 'A mixed effects model', 'A spatial autocorrelation model', 'A quantile regression model', 'A panel data model', 'An entity fixed effects model', 'A time fixed effects model']\",\"question\":\"Consider the following equation and determine the class of model that it best represents\\n\\n$y_{it} = \\\\alpha + \\\\beta_{it} + \\\\mu_i + \\\\nu_{it}$\",\"src\":\"ori_mmlu-econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}