{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"abe9882d-2395-578b-87c6-b9574c71bd48","task_key":"default--test--2972","task_revision_id":"1","upstream_id":"2972","short_description":"A biologist deals with things on a microscopic level. To A biologist deals with…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The units of length include the micron and the \\\\\\\\AAngstrom. Weights are expressed in milligrams, micrograms, and nanograms. The unit of molecular weight is the dalton.', 'The units include meter, kilogram, and second.', 'The units include the liter for volume, the hectare for area, and the joule for energy.', 'The units include mile, ton, and hour.', 'The units include foot, pound, and minute.', 'The units of length include centimeter and decimeter. Weights are expressed in grams and decigrams.', 'The units of length include the millimeter and the picometer. Weights are expressed in picograms and centigrams.', 'The units of measurement are the kilometer for length and the metric ton for weight.', 'The units of length include the inch and the yard. Weights are expressed in ounces and stones.', 'The units of length are measured in leagues and fathoms. Weights are expressed in carats and pecks.']\",\"question\":\"A biologist deals with things on a microscopic level. To A biologist deals with things on a microscopic level. To describe cellular dimensions and the amount of materials present at the cellular level, units of an appropriately small size are needed. What are these units of measurements?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}