{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d475c19f-9212-5c7e-bd30-34f13438def1","task_key":"default--test--9510","task_revision_id":"1","upstream_id":"9510","short_description":"A solid has a volume of 2.5 liters when the external pressure is 1 atm. The bulk…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['19 x 10^-3 cm³, 68 ergs/cm³', '25 x 10^-3 cm³, 80 ergs/cm³', '30 x 10^-3 cm³, 85 ergs/cm³', '18.99 x 10^-3 cm3, 65.4 ergs/cm^3', '20 x 10^-3 cm3, 70 ergs/cm^3', '12 x 10^-3 cm³, 50 ergs/cm³', '22 x 10^-3 cm3, 75 ergs/cm^3', '14 x 10^-3 cm³, 58 ergs/cm³', '17 x 10^-3 cm³, 55 ergs/cm³', '15 x 10^-3 cm3, 60 ergs/cm^3']\",\"question\":\"A solid has a volume of 2.5 liters when the external pressure is 1 atm. The bulk modulus of the material is 2 × 10^12 dynes/cm^2. What is the change in volume when the body is subjected to a pressure of 16atm? What additional energy per unit volume is now stored in the material?\",\"src\":\"stemez-Physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}