{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3d8e1f25-9bc4-588f-a68f-21734c1be189","task_key":"default--test--7077","task_revision_id":"1","upstream_id":"7077","short_description":"Can there be any economic growth in the simple circular flow model?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Economic growth in the simple circular flow model depends on external factors', 'Economic growth can occur if the population within the model increases', 'Yes, if the model is adjusted to include international trade', 'Economic growth is determined by consumer confidence within the model', 'The model allows for economic growth through increased investment only', 'Yes, there can be economic growth in the simple circular flow model', 'The simple circular flow model automatically leads to economic growth', 'Economic growth is only possible if the model includes technological advancements', 'Economic growth can occur with increased government spending within the model', 'No, there cannot be any economic growth in the simple circular flow model']\",\"question\":\"Can there be any economic growth in the simple circular flow model?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}