{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4ea0bf50-6027-597c-9f9a-91696fa894c0","task_key":"default--test--11390","task_revision_id":"1","upstream_id":"11390","short_description":"Find the current through a 0.01 \\muF capacitor at t = 0 if the voltage across it…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['0.1256 A, 0.2 A, 0.1256 A', '0.1256 A, 0.3 A, 0.1256 A', '0.2345 A, 0.1 A, - 0.4567 A', '0.2 A, 0.1 A, 0.2 A', '0 A, 0.1 A, 0 A', '0.1256 A, 0.2 A, - 0.1256 A', '0.1412 A, 0.25 A, -0.1412 A', '0.1256 A, 0 A, -0.1256 A', '0.314 A, 0.2 A, -0.314 A', '0.0628 A, 0.15 A, -0.0628 A']\",\"question\":\"Find the current through a 0.01 \\\\muF capacitor at t = 0 if the voltage across it is (a) 2 sin 2\\\\pi 10^6t V; (b) - 2e^-(10)7 t V; (c) - 2e-(10)7 tsin 2\\\\pi 10^6t V.\",\"src\":\"stemez-ElectricCircuits\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}