{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"675da8a8-2356-5d47-9ad0-23d1a2855886","task_key":"default--test--12180","task_revision_id":"1","upstream_id":"12180","short_description":"Benzene andiso-pentane are mixed at 1.5 atm. and 110°F. Determine the…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['x_B= 0.15, x_P= 0.85, y_B= 0.25, y_P= 0.75', 'x_B= 0.10, x_P= 0.90, y_B= 0.15, y_P= 0.85', 'x_B= 0.20, x_P= 0.80, y_B= 0.10, y_P= 0.90', 'x_B= 0.30, x_P= 0.70, y_B= 0.02, y_P= 0.98', 'x_B= 0.50, x_P= 0.50, y_B= 0.20, y_P= 0.80', 'x_B= 0.05, x_P= 0.95, y_B= 0.60, y_P= 0.40', 'x_B= 0.40, x_P= 0.60, y_B= 0.30, y_P= 0.70', 'x_B= 0.13, x_P= 0.87, y_B= 0.02, y_P= 0.98', 'x_B= 0.13, x_P= 0.87, y_B= 0.05, y_P= 0.95', 'x_B= 0.25, x_P= 0.75, y_B= 0.40, y_P= 0.60']\",\"question\":\"Benzene andiso-pentane are mixed at 1.5 atm. and 110°F. Determine the compositions of the liquid and vapor using Raoult'slaw.\",\"src\":\"stemez-TransportPhenomena\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}