{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cb5f5269-d06d-5fd2-ab98-af9501dafb57","task_key":"default--test--6937","task_revision_id":"1","upstream_id":"6937","short_description":"State one important reason why Smith's principle of the \"invisible hand\" does…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"[\\\"Smith's principle is outdated\\\", \\\"Smith's principle relies on the assumption of unlimited natural resources\\\", 'Government intervention is always necessary', 'The \\\"invisible hand\\\" is countered by the presence of monopolies and oligopolies', \\\"Perfect competition is required for Smith's principle to be completely effective\\\", 'The principle is based on global, not national, economies', \\\"Smith's principle does not account for externalities affecting the economy\\\", \\\"Smith's principle assumes all actors have perfect information\\\", 'The \\\"invisible hand\\\" only works in non-technological markets', \\\"Smith's principle only applies to certain markets\\\"]\",\"question\":\"State one important reason why Smith's principle of the \\\"invisible hand\\\" does not assure the \\\"perfect functioning,\\\" without government intervention, of the U.S. economy today.\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}