{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"729088a7-0f37-5779-863d-ec4a28c89699","task_key":"default--test--12066","task_revision_id":"1","upstream_id":"12066","short_description":"A gravity fed lock in a proposed shipping canal is to be studied with a…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['5 min, \\\\\\\\(\\\\\\\\lambda^7/2\\\\\\\\)', '9 min, \\\\\\\\lambda^3/2', '11 min, \\\\\\\\(\\\\\\\\lambda^4\\\\\\\\)', '12 min, \\\\\\\\(\\\\\\\\lambda^5/3\\\\\\\\)', '7 min, \\\\\\\\lambda^4/2', '6 min, \\\\\\\\lambda^6/2', '8 min, \\\\\\\\lambda^5/2', '4 min, \\\\\\\\(\\\\\\\\lambda^2\\\\\\\\)', '10 min, \\\\\\\\(\\\\\\\\lambda^3\\\\\\\\)', '15 min, \\\\\\\\(\\\\\\\\lambda^7/3\\\\\\\\)']\",\"question\":\"A gravity fed lock in a proposed shipping canal is to be studied with a 1/100-scale geometrically similar model. (a) If the model lock fills in 0.8 min, estimate the time for the prototype to fill. (b) Find the ratio of corresponding mass flow rates in the model and prototype locks.\",\"src\":\"stemez-FluidMechanics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}