{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"627e0a20-5dcd-5a25-a44f-7a3d8b16f6a9","task_key":"default--test--7081","task_revision_id":"1","upstream_id":"7081","short_description":"Adam Smith relied on the workings of the profit motive in his theory of the…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Smith thought that the fear of public backlash and loss of reputation would keep businesses from engaging in conspiracies.', 'Smith believed in the unchecked profit motive.', 'Smith called for government intervention in business.', 'Smith believed that competition could regulate and control the profit motive, preventing price-fixing conspiracies. He would not call for government intervention.', 'Smith felt that moral sentiments would naturally discourage businessmen from conspiracies without requiring government intervention.', 'Smith advocated for strict regulations on business practices to prevent any form of conspiracy against the public.', 'Smith supported legal monopolies.', 'Smith trusted in a self-regulating economy where market forces would dissolve monopolies without any external interference.', \\\"Smith argued that consumers' choices would be enough to disrupt any attempts at a conspiracy against the public.\\\", 'Smith suggested that the natural cycle of economic booms and busts would prevent long-term conspiracies and monopolistic practices.']\",\"question\":\"Adam Smith relied on the workings of the profit motive in his theory of the 'invisible hand'. Yet, at the same time, he attacked businessmen for their attempts at 'conspiracy against the public'. How did Smith reconcile hiseconomic system with the greed of some businessmen? Would hecall for government intervention in order to break up these conspiracies ?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}