{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c7fcf1c4-0787-557b-ae4b-dd9a0e917b14","task_key":"default--test--8668","task_revision_id":"1","upstream_id":"8668","short_description":"Which of the following is the central limit theorem?","config":"default","split":"test","body":"{\"category\":\"math\",\"options\":\"['The central limit theorem states that the mean of a large number of independent and identically distributed random variables, each with finite mean and variance, will approximately follow a normal distribution.', 'If the population is uniformly distributed, then as the sample size increases, the sampling distribution of the sample mean becomes closer to a normal distribution.', 'No matter how the population is distributed, as the sample size increases, the standard deviation of the sample means becomes closer to the standard deviation of the population divided by the square root of the sample size.', 'If the population is normally distributed, then as the sample size increases, the sampling distribution of the sample mean becomes closer to a normal distribution.', 'The central limit theorem states that the median of a large number of independent and identically distributed random variables, each with finite mean and variance, will approximately follow a normal distribution.', 'The central limit theorem refers to something else.', 'The central limit theorem states that as the sample size increases, the median of the sample means becomes closer to the median of the population.', 'No matter how the population is distributed, as the sample size increases, the mean of the sample means becomes closer to the mean of the population.', 'Regardless of the distribution of the population, the variance of the sample means will converge to the variance of the population as the sample size increases.', 'The central limit theorem states that the sum of a large number of independent and identically distributed random variables, each with finite mean and variance, will approximately follow a normal distribution, regardless of the shape of the original measurement distribution.']\",\"question\":\"Which of the following is the central limit theorem?\",\"src\":\"ori_mmlu-high_school_statistics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}