{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2089c251-6d09-5f8e-b01e-217fbef9ab14","task_key":"default--test--10253","task_revision_id":"1","upstream_id":"10253","short_description":"The potential energy of a compressed spring and the potential energy of a…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['the work done on them', 'Both of these', 'Neither of these', 'the force applied to them', 'the distance they travel', 'the temperature of the environment they are in', 'motion', 'the material they are made of', 'the time they are in use', 'the speed they move at']\",\"question\":\"The potential energy of a compressed spring and the potential energy of a charged object both depend on\",\"src\":\"ori_mmlu-conceptual_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}