{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5c8b95d2-e264-59c6-8b90-8b5803d58d83","task_key":"default--test--10244","task_revision_id":"1","upstream_id":"10244","short_description":"The photoelectric work functions for several metals are listed below. Calculate…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['K and Cu', 'Cs and Cu', 'All metals listed', 'Cs and K', 'W and Zn', 'W and Cs', 'None of the metals listed', 'Cu and Zn', 'K and Zn', 'W and K']\",\"question\":\"The photoelectric work functions for several metals are listed below. Calculate the threshold wavelengths for each metal. Which metals will not emit photoelectrons when illuminated with visible light? W- (Joules) Cs 3.2 × 10^-19 Cu 6.4 ×10^-19 K 3.6 ×10^-19 Zn 5.8 ×10^-19\",\"src\":\"stemez-Physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}