{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ce0d44ec-2ca8-5488-9d15-5a22295d0610","task_key":"default--test--4023","task_revision_id":"1","upstream_id":"4023","short_description":"In a hydrogen bomb, deuterium nuclei fuse to produce a helium nucleus. In the…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['50 liters of gasoline', '500 liters of gasoline', '400 liters of gasoline', '150 liters of gasoline', '243 liters of gasoline', '600 liters of gasoline', '350 liters of gasoline', '75 liters of gasoline', '800 liters of gasoline', '100 liters of gasoline']\",\"question\":\"In a hydrogen bomb, deuterium nuclei fuse to produce a helium nucleus. In the process, 5MeV of energy is re-leased per deuterium. If, 1/7000 of natural H is D, how many liters of gasoline (C_8H_18) are needed to be burned to produce the same amount of energy as derived from 1 liter of water. Assume the following: the heat of combustion of gasoline is 5100 KJ/mole the density of gasoline is .703 g/cm^3; leV = 1.60 × 10^-19 J.\",\"src\":\"stemez-Chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}