{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c257f267-824a-5eb3-9513-1579a164a703","task_key":"default--test--7279","task_revision_id":"1","upstream_id":"7279","short_description":"What gives rise to the so-called pecuniary economies or diseconomies of scale","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Changes in the market demand and supply', 'Changes in the short-term operational efficiency of the company', 'Fluctuations in the stock market affecting the company’s capital valuation', 'Changes in the overall economic condition', 'Changes in the long-run cost per unit of output due to variations in the prices of inputs', 'Variations in employee productivity and labor costs', 'Changes in government regulations and tax policies', \\\"Adjustments in the company's advertising and marketing strategies\\\", \\\"Changes in the company's internal management\\\", 'Shifts in consumer preferences and brand loyalty']\",\"question\":\"What gives rise to the so-called pecuniary economies or diseconomies of scale\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}