{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d8250535-adb1-53b1-95c6-b3aaf036bd1f","task_key":"default--test--8981","task_revision_id":"1","upstream_id":"8981","short_description":"Which of the following statements about the correlation coefficient is true?","config":"default","split":"test","body":"{\"category\":\"math\",\"options\":\"['A correlation of 1 indicates a perfect cause-and-effect relationship between the variables.', 'A correlation of -1 indicates a perfect cause-and-effect relationship between the variables.', 'The correlation coefficient is always less than 0.', 'Correlation applies equally well to quantitative and categorical data.', 'The correlation coefficient and the slope of the regression line are always equal.', 'The correlation coefficient and the slope of the regression line may have opposite signs.', 'Correlations of +0.87 and -0.87 indicate the same degree of clustering around the regression line.', 'A correlation of 0 indicates a strong positive relationship between the variables.']\",\"question\":\"Which of the following statements about the correlation coefficient is true?\",\"src\":\"ori_mmlu-high_school_statistics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}