{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2ea8f992-c977-5200-867e-d8205d0c9702","task_key":"default--test--12163","task_revision_id":"1","upstream_id":"12163","short_description":"Find the magnetic energy associated with unit length of an infinitely long…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['finite', 'Constant for all wire sizes and currents', 'Proportional to the inverse square of the current I', 'infinite', 'Proportional to the radius a', 'Dependent on the material of the conductor', 'Inversely proportional to the radius a', 'zero', 'dependent on the size of the conductor', 'Proportional to the square of the current I']\",\"question\":\"Find the magnetic energy associated with unit length of an infinitely long straight wire of radius a carrying a current I.\",\"src\":\"stemez-Electromagnetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}