{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4b406a00-4201-521c-9239-e94275efd11a","task_key":"default--test--7463","task_revision_id":"1","upstream_id":"7463","short_description":"in-come elasticity of imports and interest elasticity of in-vestments?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Income elasticity of imports measures the responsiveness of imports to a change in the price level, and interest elasticity of investments measures the responsiveness of investment to changes in savings rates', 'Both income elasticity of imports and interest elasticity of investments measure the responsiveness of imports to a change in income', 'Both income elasticity of imports and interest elasticity of investments measure the responsiveness of exports to changes in income', 'Income elasticity of imports measures the responsiveness of imports to a change in income, and interest elasticity of investments measures the responsiveness of investment to a change in the interest rate', 'Income elasticity of imports measures the responsiveness of imports to a change in exchange rates, and interest elasticity of investments measures the responsiveness of investment to a change in inflation rates', 'Both income elasticity of imports and interest elasticity of investments measure the responsiveness of investment to a change in the interest rate', 'Income elasticity of imports measures the responsiveness of imports to a change in interest rate, and interest elasticity of investments measures the responsiveness of investment to a change in income', 'Interest elasticity of imports measures the responsiveness of imports to a change in income, and income elasticity of investments measures the responsiveness of investment to a change in the interest rate', 'Income elasticity of imports measures the responsiveness of imports to changes in consumer confidence, and interest elasticity of investments measures the responsiveness of investment to a change in government spending', 'Income elasticity of imports measures the responsiveness of investment to a change in income, and interest elasticity of investments measures the responsiveness of imports to a change in the interest rate']\",\"question\":\"in-come elasticity of imports and interest elasticity of in-vestments?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}