{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f0a304a3-d978-555f-8790-98e3a15a37f8","task_key":"default--test--478","task_revision_id":"1","upstream_id":"478","short_description":"A research worker was interested in racial differences in the standard of living…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['Y = 18 - 0.05 X, r = - .4867', 'Y = 16 - 0.08 X, r = -0.6000', 'Y = 20 - 0.05 X, r = - .4867', 'Y = 18 - 0.05 X, r = - .4000', 'Y = 20 - 0.07 X, r = -0.5500', 'Y = 18 + 0.06 X, r = 0.4867', 'Y = 18 - 0.06 X, r = - .4867', 'Y = 22 - 0.04 X, r = -0.3000', 'Y = 15 + 0.03 X, r = 0.3500', 'Y = 19 - 0.05 X, r = 0.4867']\",\"question\":\"A research worker was interested in racial differences in the standard of living of farm operators in the southeastern United States. He used the presence of running water in farm dwellings as a crude index of the standard of living. For each of 31 economic areas in North Carolina, South Carolina, and Georgia in 1945, he calculated two mea-sures : X = farms operated by nonwhites per 100 white farm operators and Y = percent of farms having running water in dwellings. The fol-lowing values were obtained: \\\\sum X = 1,860\\\\sum Y = 465\\\\sum XY = 23,400 \\\\sum X^2 = 201,600\\\\sum Y^2 = 7,925n = 31 Compute the regression line and the correlation of X and Y.\",\"src\":\"stemez-Business\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}