{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0df81e8c-813b-5e26-9777-1e8bbcdc5b28","task_key":"default--test--7532","task_revision_id":"1","upstream_id":"7532","short_description":"The profit-maximizing equilibrium for a monopolistically competitive firm leaves…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Society does not get enough output.', 'There is perfect competition in the market, leading to an efficient outcome.', 'Monopolistically competitive firms produce at the minimum of the average cost curve.', 'There is a socially efficient allocation of resources.', \\\"The firm's profits are minimized, leading to an equitable distribution of resources.\\\", 'Society gets too much output.', \\\"Consumers are willing to pay the price that equals the firm's marginal cost.\\\", \\\"The firm's profits are maximized at the quantity where price equals average total cost.\\\", 'Price equals marginal cost.', 'Society benefits from the variety of products offered by monopolistically competitive firms.']\",\"question\":\"The profit-maximizing equilibrium for a monopolistically competitive firm leaves marginal cost below price. Explain why this is inefficient from a societal per-spective .\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}