{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b47fa0da-ee4d-5c4c-bf50-3d40925bb9de","task_key":"default--test--11769","task_revision_id":"1","upstream_id":"11769","short_description":"Polystyrene has a relative permittivity of 2.7. If a wave is incident at an…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['20 degrees and 60 degrees', '22 degrees and 58 degrees', '30 degrees and 70 degrees', '18 degrees and 54 degrees', '15 degrees and 50 degrees', '17.7 degrees and 55.2 degrees', '10 degrees and 40 degrees', '25 degrees and 65 degrees', '35 degrees and 75 degrees', '12.3 degrees and 48.6 degrees']\",\"question\":\"Polystyrene has a relative permittivity of 2.7. If a wave is incident at an angle of\\\\texttheta_i= 30° from air onto polystyrene, calculate the angle if transmission\\\\texttheta_tInterchange polystyrene and air and repeat the calculation.\",\"src\":\"stemez-Electromagnetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}