{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"53e1d575-9144-5da9-9e00-33cfc9fa3241","task_key":"default--test--433","task_revision_id":"1","upstream_id":"433","short_description":"The UK Public Services (Social Value) Act 2013 requires those procuring ______…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['Private services, social, economic and environmental', 'Public services, social, economic and health', 'Public services, social, cultural and environmental', 'Public services, cultural, economic and social', 'Public services, social, environmental and cultural', 'Private services, social, cultural and economic', 'Private services, social, environmental and cultural', 'Private services, social, economic and health', 'Private services, cultural, economic and environmental', 'Public services, social, economic and environmental']\",\"question\":\"The UK Public Services (Social Value) Act 2013 requires those procuring ______ to consider how they can secure wider _____, _____and _____ benefits.\",\"src\":\"ori_mmlu-business_ethics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}