{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4492d838-f87e-58a3-882e-da4799a69352","task_key":"default--test--7044","task_revision_id":"1","upstream_id":"7044","short_description":"Which of the following correctly illustrates why price (P) equals marginal…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['II and III, with the addition of IV. Demand and Price are represented as a downward sloping function for monopoly.', 'I, II and III, with the addition of IV. Demand and Price are represented as a horizontal function for perfect competition.', 'I and II.', 'I and III.', 'I, II, and III.', 'I only.', 'II only.', 'I and III, with the addition of IV. MR = P = demand on downward sloping function for monopoly.', 'III only.', 'II and III.']\",\"question\":\"Which of the following correctly illustrates why price (P) equals marginal revenue (MR) under perfect competition, and why price (P) is greater than marginal revenue under monopoly or imperfect competition? I. MR = P = demand on horizontal function for perfect competition. II. P > MR as downward sloping functions for imperfect competition. III. Demand and Price are represented as a vertical function for imperfect competition.\",\"src\":\"ori_mmlu-high_school_microeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}