{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"26a5d44d-3ee3-5c07-ba41-8691db7280b5","task_key":"default--test--7124","task_revision_id":"1","upstream_id":"7124","short_description":"Consider the OLS estimator for the standard error of the slope coefficient.…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['(i), (ii), and (iv) only', '(i), (ii), (iii), and (iv)', '(i), (ii), and (iii) only', '(iii) and (iv) only', '(ii) and (iii) only', '(i) and (iv) only', '(i) and (iii) only', '(i), (iii), and (iv) only', '(ii) and (iv) only', '(ii), (iii), and (iv) only']\",\"question\":\"Consider the OLS estimator for the standard error of the slope coefficient. Which of the following statement(s) is (are) true?\\n\\n(i) The standard error will be positively related to the residual variance\\n\\n(ii) The standard error will be negatively related to the dispersion of the observations on the explanatory variable about their mean value\\n\\n(iii) The standard error will be negatively related to the sample size\\n\\n(iv) The standard error gives a measure of the precision of the coefficient estimate.\",\"src\":\"ori_mmlu-econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}