{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f26f39a1-32b9-5338-8b9b-7609951d594b","task_key":"default--test--9286","task_revision_id":"1","upstream_id":"9286","short_description":"As the explosive TNT burns, it releases about 4.2 x 106 joules/kg. The molecular…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['1.58 × 10^-18', '2.3 × 10^-12 J', '6.5 × 10^5 eV', '7.6 × 10^10', '5.0 × 10^-9 eV', '1.2 × 10^-20 J', '3.1 × 10^-10 J', '8.2 × 10^-19 J', '9.8eV', '4.7 × 10^-11']\",\"question\":\"As the explosive TNT burns, it releases about 4.2 x 106 joules/kg. The molecular weight of TNT is 227. Find the energy released by one molecule of TNT in the process. What is the fractional change in mass that occurs as one kg of TNT explodes?\",\"src\":\"stemez-Physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}