{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"60406f6b-436a-5d8b-ac7c-1e4bc799f4b6","task_key":"default--test--11477","task_revision_id":"1","upstream_id":"11477","short_description":"Evaluate the frictional torque delivered and the axial force developedbetween…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['19,352 lbs.-in., 2513.27 lbs.', '22,000 lbs.-in., 2900 lbs.', '18,000 lbs.-in., 2500 lbs.', '12,000 lbs.-in., 2600 lbs.', '17,500 lbs.-in., 2300 lbs.', '9676 lbs.-in., 2513.27 lbs.', '10,673 lbs.-in., 2765 lbs.', '21,346 lbs.-in., 2765 lbs.', '8,500 lbs.-in., 2200 lbs.', '15,000 lbs.-in., 3000 lbs.']\",\"question\":\"Evaluate the frictional torque delivered and the axial force developedbetween the discs for a one plate clutch assumingthat both sides of the plate deliver torque. The coefficientof friction for the clutch material is 0.35 and the maximumpermissible pressure is 20 psi. The clutch has an insideand outside diameter of 20 in. and 24 in., respectively.\",\"src\":\"stemez-MachineDesign\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}