{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4c9f36b6-ac06-57ab-ad8e-0738a4207598","task_key":"default--test--7609","task_revision_id":"1","upstream_id":"7609","short_description":"Adam Smith's 'invisible hand' operates in the free market system, with active…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Public interest is to control the market', 'Public interest is to establish monopolies in key industries', 'Public interest is to distribute wealth equally', 'Public interest is to prioritize environmental conservation over economic growth', 'Public interest is to use the scarce resources as efficiently as possible', \\\"Public interest is to ensure the government's intervention in all economic activities\\\", 'Public interest is to maximize individual profits', 'Public interest is to promote international trade exclusively', 'Public interest is to provide subsidies to all businesses', 'Public interest is to guarantee minimum prices for all products']\",\"question\":\"Adam Smith's 'invisible hand' operates in the free market system, with active competition, that aligns the self-interests of individuals with the \\\"public interest\\\". What exactly is the \\\"public interest\\\"?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}