{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"24caac16-0cc2-5b6c-9d7b-906e2fa214c1","task_key":"default--test--7136","task_revision_id":"1","upstream_id":"7136","short_description":"Suppose the production process is lengthy and 75% of the capital input at…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Investments are proportionate to the variance between actual and expected GNP for the next period only.', 'Investments are based on a 50% consideration of the present GNP and 50% on the GNP two periods ahead.', 'Investments are solely based on present GNP.', 'Investments are solely based on future GNP.', 'Investments are predicted by a model that factors in only the GNP growth rate of the previous two periods.', 'Investments are based on a fixed percentage of present GNP, without consideration for past or future output.', 'Investments are adjusted based on a moving average of GNP over the past three periods, without forecasting future output.', 'Investments are based on expectation of GNP in the future, present GNP, and past GNP.', 'Investments are determined by a complex formula that incorporates present GNP, inflation rates, and interest rates, but not past or future GNP.', 'Investments are solely based on past GNP.']\",\"question\":\"Suppose the production process is lengthy and 75% of the capital input at present is dependent on the output in the next period, and 25% is dependent on the output in the period thereafter. The technical capital / output ratio is 3. Furthermore, business reacts cautiously to capital shortages; it will only provide capital for 80% of the present gap and 10% of the preceding gap. Can you describe thisdistributed lag accelerator process?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}