{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"42ab06b4-4819-5211-a565-1c362370d0ad","task_key":"default--test--2493","task_revision_id":"1","upstream_id":"2493","short_description":"Discuss the meaning of the term significant difference.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['A significant difference implies that the results from two samples are likely due to measurement error.', 'A significant difference is observed when two samples show exactly the same results.', 'A significant difference means the results from two samples are within a predetermined margin of error.', 'A significant difference exists only when the sample sizes are large enough to ensure accuracy.', 'A significant difference signifies that two samples are from the same population.', 'A significant difference is always due to random variation.', 'A significant difference indicates that any observed differences between samples are due to chance alone.', 'A significant difference is determined solely by the difference in means between two samples, regardless of the variability or sample size.', 'A significant difference signifies that two samples are from different populations. This difference is so large that it would rarely occur because of sampling variability alone.', 'A significant difference is one where the results can be exactly replicated in subsequent experiments.']\",\"question\":\"Discuss the meaning of the term significant difference.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}