{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"83c31b91-7cbd-5ed1-a377-d1353b2d3534","task_key":"default--test--7407","task_revision_id":"1","upstream_id":"7407","short_description":"How does capitalism stimulate and encourage technological advance?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Technological advance in capitalism is a result of governmental regulations.', 'In capitalism, technological advance is accidental and not directly related to market mechanisms.', 'Technological advances under capitalism are primarily driven by non-profit organizations.', 'Capitalism hinders technological advance by prioritizing short-term profits over long-term innovation.', 'Capitalism stimulates technological advance solely through direct state intervention and subsidies.', 'Capitalism has no impact on technological advance.', 'Pure capitalism stimulates and encourages technological advance by providing opportunities and incentives for technological innovation.', 'Technological advance is stimulated by capitalism only when there is a global crisis.', 'Capitalism only stimulates technological advance in specific sectors, not across the entire economy.', 'Capitalism discourages technological advance due to competition.']\",\"question\":\"How does capitalism stimulate and encourage technological advance?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}