{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"28d82ec2-edd4-540d-9f9f-9f95164796c8","task_key":"default--test--7795","task_revision_id":"1","upstream_id":"7795","short_description":"Which of these explains why t should be used instead of z for inference…","config":"default","split":"test","body":"{\"category\":\"math\",\"options\":\"['The use of t instead of z is simply a convention in statistics, with no mathematical reason.', 'The Central Limit Theorem applies to means but not proportions.', 'We use z for proportions because proportions are approximately normal. Means are not.', 'We use z for proportions because the sampling distribution of sample proportions is approximately normal, but that is not the case for the sampling distribution of sample means.', 'We use t for means because the sampling distribution of sample means is approximately normal, but that is not the case for proportions.', 'When using the sample standard deviation to estimate the population standard deviation, more variability is introduced into the sampling distribution of the statistic.', 'The Central Limit Theorem applies to proportions but not means.', 'We use t for means because it provides a more accurate estimate of the population mean.']\",\"question\":\"Which of these explains why t should be used instead of z for inference procedures for means.\",\"src\":\"ori_mmlu-high_school_statistics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}