{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ec7b3a14-6376-5ffb-869e-53bfcb83d858","task_key":"default--test--12038","task_revision_id":"1","upstream_id":"12038","short_description":"It is desired to remove water from an air-water mixture which contains35 percent…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['0.07 lb / mole / ft^2-hr', '0.1 lb / mole / ft^2-hr', '0.11 lb / mole / ft^2-hr', '0.09 lb / mole / ft^2-hr', '0.08 lb / mole / ft^2-hr', '0.04 lb / mole / ft^2-hr', '0.06 lb / mole / ft^2-hr', '0.02 lb / mole / ft^2-hr', '0.05 lb / mole / ft^2-hr', '0.13 lb / mole / ft^2-hr']\",\"question\":\"It is desired to remove water from an air-water mixture which contains35 percent water by volume. The mixture diffuses into a section of still air 0.2 in. in length, after which it is completely removed from the mixture by absorption. At the absorption plane, the water concentration is small enough to be neglected. The system operates at 1atmand 59.0°C. Determine the rate of water diffusing through the air layer.\",\"src\":\"stemez-TransportPhenomena\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}