{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f62c0273-9219-5b47-80e1-f4ded3bf767b","task_key":"default--test--8555","task_revision_id":"1","upstream_id":"8555","short_description":"For the regression line, which of the following statements about residuals is…","config":"default","split":"test","body":"{\"category\":\"math\",\"options\":\"['The sum of the residuals is always one.', 'If the correlation is 0, there will be a distinct pattern in the residual plot.', 'The larger the residuals, the better the linear model.', 'The residuals are always negative.', 'If the correlation is 1, there will be a distinct pattern in the residual plot.', 'The residual plot will always be a straight line.', 'Influential scores have large residuals.', 'The mean of the residuals is always zero.', 'If the linear model is good, the number of positive residuals will be the same as the number of negative residuals.', 'The residuals can never be zero.']\",\"question\":\"For the regression line, which of the following statements about residuals is true?\",\"src\":\"ori_mmlu-high_school_statistics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}