{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a7ecd69d-6c2f-5daa-9196-db431ca146f0","task_key":"default--test--7662","task_revision_id":"1","upstream_id":"7662","short_description":"What is the coefficient of elasticity?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['The sum of the percentage changes in both the dependent and independent variables', 'The percentage change in the independent variable divided by the percentage change in the dependent variable', 'The ratio of the percentage change in the independent variable to the absolute change in the dependent variable', 'The absolute change in the dependent variable divided by the absolute change in the independent variable', 'The ratio of the change in the dependent variable to the change in the independent variable', 'The percentage change in the dependent variable divided by the percentage change in the independent variable', 'The change in the independent variable divided by the change in the dependent variable', 'The percentage change in the dependent variable divided by the absolute change in the independent variable', 'The absolute change in the independent variable divided by the percentage change in the dependent variable', 'The sum of the changes in the dependent and independent variables']\",\"question\":\"What is the coefficient of elasticity?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}