{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"63bba1c1-1e0e-5eaf-8e87-389037399767","task_key":"default--test--569","task_revision_id":"1","upstream_id":"569","short_description":"The rise in business led, private regulation can be attributed to: encouragement…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['Proactive, Cost effectiveness, Faster', 'Reactive, Cost effectiveness, Slower', 'Faster, Cost effectiveness, Slower', 'Proactive, Heightened costs, Faster', 'Proactive, Cost effectiveness, Slower', 'Proactive, Cost ineffectiveness, Slower', 'Reactive, Heightened costs, Faster', 'Faster, Cost ineffectiveness, Faster', 'Reactive, Cost ineffectiveness, Faster', 'Faster, Heightened costs, Slower']\",\"question\":\"The rise in business led, private regulation can be attributed to: encouragement of a _______ approach from industry, _________ and _______ achievement of objectives.\",\"src\":\"ori_mmlu-business_ethics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}