{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"31d350cc-5b20-5b98-8340-df6df6b4c658","task_key":"default--test--7212","task_revision_id":"1","upstream_id":"7212","short_description":"How does the price mechanism act to conservethose productsand resources which…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['The price mechanism guarantees an equal distribution of scarce resources among consumers.', 'The price mechanism ensures that scarce resources are only used by the government.', 'The price mechanism has no effect on the conservation of scarce resources.', 'The price mechanism leads to a rapid depletion of scarce resources due to increased demand.', 'The price mechanism caps the price of scarce resources to make them affordable.', 'The price mechanism reduces the production of scarce resources.', 'The price mechanism discourages consumers from buying scarce resources.', 'The price mechanism allocates scarce resources to the highest bidders, regardless of the conservation status.', 'The price mechanism induces consumers to search for substitutes, an act which will tend to conserve the scarce resource.', 'The price mechanism encourages overuse of scarce resources.']\",\"question\":\"How does the price mechanism act to conservethose productsand resources which are most scarce?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}