{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"66363a7d-8159-526b-a78f-465694139cab","task_key":"default--test--11710","task_revision_id":"1","upstream_id":"11710","short_description":"A (1/4) in. thick belt operates on a 1 ft. pulley rotating at 800 rpm and…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['5.0 in.', '2.0 in.', '1.5 in.', '7.0 in.', '3.0 in.', '4.5 in.', '4.0 in.', '3.5 in.', '2.5 in.', '6.0 in.']\",\"question\":\"A (1/4) in. thick belt operates on a 1 ft. pulley rotating at 800 rpm and delivers 25 hp. Calculate the belt width based on the following data: a) the allowable belt stress is 550 psi. b) the angle of contact is 160 degrees. c) the coefficient of friction is 0.45. d) the specific weight of belt material is 0.04 lb./cu-in.\",\"src\":\"stemez-MachineDesign\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}