{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2e1e0f9e-9970-552c-ac3d-1680e6bc6d34","task_key":"default--test--12173","task_revision_id":"1","upstream_id":"12173","short_description":"A key is used to fasten a pulley having a 3(1/2) in. long hub, delivering a…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['Minimum length of the key is 2.0 in and length of the key when both key and shaft are of the same material is 3.5 in.', 'Minimum length of the key is 3.5 in and length of the key when both key and shaft are of the same material is 3.0 in.', 'Minimum length of the key is 2.5 in and length of the key when both key and shaft are of the same material is 4.0 in.', 'Minimum length of the key is 1.5 in and length of the key when both key and shaft are of the same material is 4.0 in.', 'Minimum length of the key is 1.0 in and length of the key when both key and shaft are of the same material is 2.5 in.', 'Minimum length of the key is 2.0 in and length of the key when both key and shaft are of the same material is 4.5 in.', 'Minimum length of the key is 1.5 in and length of the key when both key and shaft are of the same material is 3.0 in.', 'Minimum length of the key is 1.0 in and length of the key when both key and shaft are of the same material is 3.0 in.', 'Minimum length of the key is 3.0 in and length of the key when both key and shaft are of the same material is 2.0 in.', 'Minimum length of the key is 2.5 in and length of the key when both key and shaft are of the same material is 5.0 in.']\",\"question\":\"A key is used to fasten a pulley having a 3(1/2) in. long hub, delivering a torque of 1250 lbs.-ft. to a shaft 2(1/2) in., in diameter. If the pulley is made of ASTM 25 gray cast-iron, the shaft and key of cold drawn AISI 1020 and hot rolled 1010 steel respectively, determine the following under conditions of moderate shock: (a) the least permissible key length. (b) the key length, considering the key and shaft to be of the same material.\",\"src\":\"stemez-MachineDesign\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}