{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bd48d075-f2e5-5784-9126-83bc2d70ac36","task_key":"default--test--12150","task_revision_id":"1","upstream_id":"12150","short_description":"A 1,500-kw six-phase synchronous converter has a full-load d-c voltage of 600.…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['(a) 175 volts, (b) 3,500 amp, (c) 1,750 amp', '(a) 289 volts, (b) 2,750 amp, (c) 1,375 amp', '(a) 300 volts, (b) 2,000 amp, (c) 1,000 amp', '(a) 100 volts, (b) 1,500 amp, (c) 800 amp', '(a) 250 volts, (b) 3,250 amp, (c) 1,625 amp', '(a) 212.4 volts, (b) 2,500 amp, (c) 1,180 amp', '(a) 346.4 volts, (b) 2,200 amp, (c) 1,200 amp', '(a) 415 volts, (b) 1,800 amp, (c) 900 amp', '(a) 480 volts, (b) 1,250 amp, (c) 625 amp', '(a) 400 volts, (b) 3,000 amp, (c) 1,500 amp']\",\"question\":\"A 1,500-kw six-phase synchronous converter has a full-load d-c voltage of 600. Determines (a) the a-c voltage between rings; (b) the d-c output; (c) the a-c input per line.\",\"src\":\"stemez-ElectricalMachines\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}