{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"66480c1c-4e18-5301-ad90-9e1583f3ff18","task_key":"default--test--12147","task_revision_id":"1","upstream_id":"12147","short_description":"5 model of a submerged buoy. If the maximum water currents to be expected are 3…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['200 fps, 25 lb', '220 fps, 30 lb', '175 fps, 19 lb', '165 fps, 18 lb', '190 fps, 21 lb', '210 fps, 28 lb', '150 fps, 20 lb', '180 fps, 22 lb', '196 fps, 24 lb', '155 fps, 17 lb']\",\"question\":\"5 model of a submerged buoy. If the maximum water currents to be expected are 3 fps, what air speed should be used to insure similarity of the flow pattern? To what prototype drag would a model drag of 5.0 lb correspond?\",\"src\":\"stemez-FluidMechanics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}