{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"85b5a08a-ed8a-5702-92e6-0010a23eb5a3","task_key":"default--test--11712","task_revision_id":"1","upstream_id":"11712","short_description":"A pair of mating spur gears increases the speed of the shaft approximately by 4…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['V_R = 4.5, C_d = 12.5 in.', 'V_R = 3.948, C_d = 14 in.', 'V_R = 4.2, C_d = 13 in.', 'V_R = 3.2, C_d = 12.2 in.', 'V_R = 3.948, C_d = 12 in.', 'V_R = 3.5, C_d = 11 in.', 'V_R = 4.05, C_d = 11.5 in.', 'V_R = 3.85, C_d = 13.5 in.', 'V_R = 4.8, C_d = 24 in.', 'V_R = 2.948, C_d = 10 in.']\",\"question\":\"A pair of mating spur gears increases the speed of the shaft approximately by 4 times. Thediametralpitch for the gear is 8 in. and it is desired that the center distance be approximately 12 in. Determine the actual velocity ratio and the center distance for the gears.\",\"src\":\"stemez-MachineDesign\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}