{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"07eb1d31-d3a0-5dda-8599-000b4d693315","task_key":"default--test--7518","task_revision_id":"1","upstream_id":"7518","short_description":"How can economies of scale contribute to growth?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Economies of scale contribute to growth by increasing the price of goods.', 'Economies of scale contribute to growth by decreasing the demand for goods.', 'Economies of scale hinder growth by increasing production costs.', 'Economies of scale contribute to growth by enabling firms, and countries, to produce goods at lower average cost.']\",\"question\":\"How can economies of scale contribute to growth?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}