{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3f5435b7-c625-5df3-b8ca-5c2f62b87c92","task_key":"default--test--7142","task_revision_id":"1","upstream_id":"7142","short_description":"Why did theinstitutionalistsof the early twentieth century reject laissez-faire?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['They held the view that government intervention would reduce economic freedom.', 'They were convinced that laissez-faire would ensure equitable wealth distribution.', 'They were disturbed by the wide spread poverty and the fluctuations of the business cycle.', 'They thought laissez-faire would lead to more efficient and ethical business practices.', 'They favored the principles of socialism.', 'They believed in the laws of supply and demand.', 'They were satisfied with the state of the economy.', 'They believed laissez-faire policies would prevent economic crises.', 'They felt that laissez-faire would naturally eliminate corruption and monopolies.', 'They were proponents of complete government control over the economy.']\",\"question\":\"Why did theinstitutionalistsof the early twentieth century reject laissez-faire?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}