{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c1f3715f-da0c-5bab-ad96-6d66e7a95bb9","task_key":"default--test--11305","task_revision_id":"1","upstream_id":"11305","short_description":"The drag of a ship in water is assumed to depend on the Reynolds number and the…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['both Froude and Reynolds numbers need to be greater in the prototype', 'only Weber numbers need to be equal for model and prototype', 'the attainment of dynamic similarity in model and prototype is not possible', 'both Froude and Reynolds numbers need to be smaller in the model', 'similitude can be achieved by matching the Euler numbers only', 'the attainment of dynamic similarity in model and prototype is possible', 'dynamic similarity is irrelevant for predicting performance', 'the attainment of geometric similarity in model and prototype is sufficient', 'only Reynolds numbers need to be equal for model and prototype', 'only Froude numbers need to be equal for model and prototype']\",\"question\":\"The drag of a ship in water is assumed to depend on the Reynolds number and the Froude number so that [drag / {(1/2)(\\\\rhoV^2A)}] = f [{(\\\\rhoVD) / \\\\mu}, (V^2 / gD)] It is proposed that a model one-tenth the size of a full-scale ship be tested in water and the results be used to predict the performance of the full-scale ship. Is this feasible?\",\"src\":\"stemez-FluidMechanics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}