{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2a7efe0d-80a0-5e61-b029-6b20618c5abf","task_key":"default--test--11310","task_revision_id":"1","upstream_id":"11310","short_description":"A 10kVA distribution transformer has a 240V secondary winding. The equivalent…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['110% of rated load', '90% of rated load', '100% of rated load', '95% of rated load', '50% of rated load', '105% of rated load', '85% of rated load', '70% of rated load', '60% of rated load', '80% of rated load']\",\"question\":\"A 10kVA distribution transformer has a 240V secondary winding. The equivalent internal resistance of this transformer, referred to that winding, is 0.048\\\\Omega. The core lossof this transformer is 75W. At whatkVAload will this transformeroperate at maximum efficiency?\",\"src\":\"stemez-ElectricalMachines\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}