{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7de95b6d-cf21-52ca-84fe-8d2d3f7c2cd3","task_key":"default--test--7675","task_revision_id":"1","upstream_id":"7675","short_description":"Why, according to Marx, are capitalists forced to accumulate?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['To maintain a minimum standard of living for workers', 'desire for personal wealth', 'To fund social welfare programs', 'To prevent the depreciation of their capital', 'government regulations', 'Legal requirements for continuous growth', 'Pressure from shareholders to maximize dividends', 'fierce competition of the free market', 'increased consumer demand', 'Historical inevitability of class struggle']\",\"question\":\"Why, according to Marx, are capitalists forced to accumulate?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}