{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"493bf5f0-a3ef-5347-be84-929e1bd59c49","task_key":"default--test--11308","task_revision_id":"1","upstream_id":"11308","short_description":"(i)Whatis the circular-milarea of a wire (a) 0.1 in., (b)0.2 in., (c) 0.325 in.…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['(i) (a) 12,500 cir mils, (b) 50,000 cir mils, (c) 126,562 cir mils (ii) 5.60 ohms', '(i) (a) 7,500 cir mils, (b) 30,000 cir mils, (c) 75,625 cir mils (ii) 4.60 ohms', '(i) (a) 15,000 cir mils, (b) 60,000 cir mils, (c) 158,438 cir mils (ii) 6.45 ohms', '(i) (a) 10,000 cir mils, (b) 40,000 cir mils, (c) 105,625 cir mils (ii) 4.45 ohms', '(i) (a) 25,000 cir mils, (b) 100,000 cir mils, (c) 253,125 cir mils (ii) 6.60 ohms', '(i) (a) 8,000 cir mils, (b) 32,000 cir mils, (c) 82,450 cir mils (ii) 7.60 ohms', '(i) (a) 14,000 cir mils, (b) 56,000 cir mils, (c) 140,500 cir mils (ii) 4.75 ohms', '(i) (a) 5,000 cir mils, (b) 20,000 cir mils, (c) 52,812 cir mils (ii) 3.45 ohms', '(i) (a) 18,000 cir mils, (b) 72,000 cir mils, (c) 183,112 cir mils (ii) 5.20 ohms', '(i) (a) 20,000 cir mils, (b) 80,000 cir mils, (c) 210,000 cir mils (ii) 5.45 ohms']\",\"question\":\"(i)Whatis the circular-milarea of a wire (a) 0.1 in., (b)0.2 in., (c) 0.325 in. in diameter ? (ii) The resistance of a length of copper wire is 3.60 ohms at 20°C.What is its resistance at 80°C ?\",\"src\":\"stemez-ElectricalMachines\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}