{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6075dfb9-7b68-5486-81b3-e65d4e8b80f6","task_key":"default--test--3145","task_revision_id":"1","upstream_id":"3145","short_description":"A biologist deals with things on a microscopic level. To A biologist deals with…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The units of measurements used are picometers, decimeters, and centiliters.', 'The units of measurements used are liters, milliliters and cubic centimeters.', 'The units of measurements used at cellular level are micron, \\\\\\\\AAngstrom, milligrams, micrograms, nanograms and dalton.', 'The units of measurements used are femtoliters, microliters, and decaliters.', 'The units of measurements used are pounds, ounces and grams.', 'The units of measurements used are feet, inches, and yards.', 'The units of measurements used are hectograms, decagrams, and carats.', 'The units of measurements used are kilometers, meters and centimeters.', 'The units of measurements used are gigapascals, megapascals, and kilopascals.', 'The units of measurements used are moles, molecules, and particles.']\",\"question\":\"A biologist deals with things on a microscopic level. To A biologist deals with things on a microscopic level. To describe cellular dimensions and the amount of materials present at the cellular level, units of an appropriately small size are needed. What are these units of measurements?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}