{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4eab878d-7efe-5166-87f8-23667c26a8b6","task_key":"default--test--2420","task_revision_id":"1","upstream_id":"2420","short_description":"What is the relative measure ofskewnessfor the datalisted below? This data…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['The distribution is positively skewed', 'The distribution has a skewness coefficient of zero', 'The distribution is negatively skewed', 'The distribution is perfectly normal', 'The distribution is uniform', 'The distribution is bimodal', 'The distribution is multimodal', 'The skewness cannot be determined from the given data', 'The distribution has no skewness', 'The distribution is symmetrical']\",\"question\":\"What is the relative measure ofskewnessfor the datalisted below? This data represents the waist measurements of six randomlyselected chocolate rabbits. 3 inches,2 inches,3.7 inches,5 inches, 2.7 inches,3 inches.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}