{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9d291bd4-8291-571f-a4b4-e1d4b8f39c14","task_key":"default--test--11491","task_revision_id":"1","upstream_id":"11491","short_description":"A 2 in. radius pure copper sphere and a pure copper cube of side2 in. are heated…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['Sphere: 750°F, Cube: 480°F', 'Sphere: 760°F, Cube: 490°F', 'Sphere: 720°F, Cube: 465°F', 'Sphere: 710°F, Cube: 470°F', 'Sphere: 740°F, Cube: 475°F', 'Sphere: 690°F, Cube: 455°F', 'Sphere: 700°F, Cube: 450°F', 'Sphere: 725°F, Cube: 467°F', 'Sphere: 800°F, Cube: 500°F', 'Sphere: 730°F, Cube: 460°F']\",\"question\":\"A 2 in. radius pure copper sphere and a pure copper cube of side2 in. are heated to 1250°F and then exposed to air at 210°F.The surface film coefficient is 12 Btu/ hr.ft^2.°F. Determine the temperature of both the sphere and the cube aftera period of 10 minutes.\",\"src\":\"stemez-TransportPhenomena\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}