{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2e0fd216-2933-57c5-bbd4-7dcc02ade00c","task_key":"default--test--9597","task_revision_id":"1","upstream_id":"9597","short_description":"Two homogeneous cylinders made of the same material rotate about their own axes…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['1:8', '1:2', '16:1', '4:1', '1:1', '1:4', '1:16', '8:1', '2:1', '2:8']\",\"question\":\"Two homogeneous cylinders made of the same material rotate about their own axes at the same angular velocity \\\\cyrchar\\\\cyromega. What is the ratio between their kinetic energies if the radius of one cylinder is twice the radius of the other?\",\"src\":\"stemez-Mechanics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}