{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8769983c-cb4a-59d3-a76e-be03b6370767","task_key":"default--test--7314","task_revision_id":"1","upstream_id":"7314","short_description":"Suppose that the value of $R^2$ for an estimated regression model is exactly…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['(i), (ii), (iii), and (iv)', '(i) and (ii) only', '(i) and (iii) only', '(iii) and (iv) only', '(ii) and (iii) only', '(ii) and (iv) only', '(ii), (iii), and (iv) only', '(i) and (iv) only', '(i), (iii), and (iv) only', '(i), (ii), and (iii) only']\",\"question\":\"Suppose that the value of $R^2$ for an estimated regression model is exactly zero. Which of the following are true?\\n\\ni) All coefficient estimates on the slopes will be zero\\n\\nii) The fitted line will be horizontal with respect to all of the explanatory variables\\n\\niii) The regression line has not explained any of the variability of y about its mean value\\n\\niv) The intercept coefficient estimate must be zero.\",\"src\":\"ori_mmlu-econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}