{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c2d6483a-efda-513a-bbc7-33f6044d000d","task_key":"default--test--11521","task_revision_id":"1","upstream_id":"11521","short_description":"Using Steinmetz law, determine the ergs loss per cycle in a coreof sheet iron…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['0.0401 joules per cycle', '0.0451 joules per cycle', '0.0101 joules per cycle', '0.0251 joules per cycle', '0.0281 joules per cycle', '0.0501 joules per cycle', '0.0201 joules per cycle', '0.0601 joules per cycle', '0.0351 joules per cycle', '0.0301 joules per cycle']\",\"question\":\"Using Steinmetz law, determine the ergs loss per cycle in a coreof sheet iron having a net volume of 40 cu cm, in which themaximum flux density is 8,000 gauss. The value of \\\\eta for sheetiron is 0.004.\",\"src\":\"stemez-ElectricalMachines\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}