{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0978cd16-012e-5972-a7c4-aa299b63e9a4","task_key":"default--test--11435","task_revision_id":"1","upstream_id":"11435","short_description":"The moving coil-meters, damping is provided by","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['the resistance of the coil.', 'the inertia of the coil.', 'the coil spring attached to the moving.', 'the electric charge in the coil.', 'the magnetic field created by the coil.', 'damping vane in the airtight chamber.', 'the friction between the coil and the frame.', 'the gravitational pull on the coil.', 'the aluminium frame of the coil.']\",\"question\":\"The moving coil-meters, damping is provided by\",\"src\":\"ori_mmlu-electrical_engineering\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}