{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9f8382d7-3592-5c28-a3a2-c0d8583447f9","task_key":"default--test--11693","task_revision_id":"1","upstream_id":"11693","short_description":"(a) Find the value of an inductor which carries 2 A. of current and in which 20…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['4 H, 140 µF', '30 H, 250 µF', '10 H, 160 \\\\\\\\muF', '5 H, 80 \\\\\\\\muF', '20 H, 320 \\\\\\\\muF', '12 H, 100 µF', '6 H, 120 µF', '25 H, 400 µF', '8 H, 200 µF', '15 H, 240 \\\\\\\\muF']\",\"question\":\"(a) Find the value of an inductor which carries 2 A. of current and in which 20 J of energy is stored. (b) Find the value of a capacitor with 500 volts across it, in which 20 J of energy is stored.\",\"src\":\"stemez-ElectricCircuits\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}