{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2b2bc311-65fc-5e99-86a0-cfe1b25805a8","task_key":"default--test--7187","task_revision_id":"1","upstream_id":"7187","short_description":"Which of the following are advantages of the use of panel data over pure…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['(ii) and (iii) only', '(i) and (ii) only', '(i), (ii), and (iii)', '(i), (ii), and (iii), plus additional benefits', '(iii) only', '(i) and (iii) only', '(ii) only', '(i) only']\",\"question\":\"Which of the following are advantages of the use of panel data over pure cross-sectional or pure time-series modelling?\\n\\n(i) The use of panel data can increase the number of degrees of freedom and therefore the power of tests\\n\\n(ii) The use of panel data allows the average value of the dependent variable to vary either cross-sectionally or over time or both\\n\\n(iii) The use of panel data enables the researcher allows the estimated relationship between the independent and dependent variables to vary either cross-sectionally or over time or both\",\"src\":\"ori_mmlu-econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}