{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5c6b6b8b-469f-5727-b9ef-6c760f33a45f","task_key":"default--test--7272","task_revision_id":"1","upstream_id":"7272","short_description":"A market demand curve is defined as a horizontal summation of all the individual…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['A vertical summation fits the definition of a market demand curve.', 'The horizontal summation reflects the prices at which consumers are willing to purchase a given quantity.', 'A vertical summation would represent the sum of the prices for each quantity, which is not meaningful.', 'The proper horizontal point is a summation of all the individual quantities demanded.', 'The market demand curve is a schedule of prices.', 'The horizontal summation allows for the calculation of the total quantity demanded at various price levels.', 'A vertical summation would show the total revenue, not the quantity demanded.', 'A vertical summation would aggregate individual demands in terms of price, not quantity.', 'The vertical summation would reflect the cumulative willingness to pay, rather than the total quantity demanded.', 'The vertical point is a summation of all individual quantities demanded.']\",\"question\":\"A market demand curve is defined as a horizontal summation of all the individual demand curves. Why is this summation taken horizontally rather than vertically?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}