{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f039a7b8-f5f6-57df-9584-ba6235bc2196","task_key":"default--test--4618","task_revision_id":"1","upstream_id":"4618","short_description":"(1) A reaction proceeds five times as fast at 60°C as it does at 30°C. Estimate…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['12.0 k cal / mole, 950 times', '10.8 k cal / mole, 1050 times', '9.7 k cal / mole, 2000 times', '12.5 k cal / mole, 500 times', '11.2 k cal / mole, 1500 times', '10.2 k cal / mole, 3000 times', '9.1 k cal / mole, 1800 times', '13.3 k cal / mole, 750 times', '14.1 k cal / mole, 1250 times', '8.6 k cal / mole, 2500 times']\",\"question\":\"(1) A reaction proceeds five times as fast at 60°C as it does at 30°C. Estimate its energy of activation. (2) For a gas phase reaction with E_A = 40,000 cal/mole, estimate the change in rate constant due to a temperature change from 1000°C to 2000°C.\",\"src\":\"stemez-Chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}