{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"39a57206-fe01-5e48-8bcc-f9b3df99672c","task_key":"default--test--2955","task_revision_id":"1","upstream_id":"2955","short_description":"Explain how an estimate of the age of a rock is made on the basisof the…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['By assessing the fossil content found within the rock layers', 'By comparing the density of the rock to a known age database', 'By examining the color and texture of the rock', 'By counting the layers of the rock', 'By measuring the amount of carbon-14 remaining in the rock', 'By observing the size and weight of the rock', 'By measuring the proportion of uranium and lead in a given rock, we can estimate with a high degree of accuracy the absolute age of the rock.', 'By calculating the rate of sediment deposition on the rock', 'By determining the magnetic properties of the rock', 'By analyzing the chemical composition of minerals within the rock for wear and degradation patterns']\",\"question\":\"Explain how an estimate of the age of a rock is made on the basisof the radioactive elements present.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}