{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4c95ae9f-61ef-5521-9dde-23d05230286a","task_key":"default--test--4277","task_revision_id":"1","upstream_id":"4277","short_description":"(a) If a rocket were fueled withkerosineand liquid oxygen, what weight of oxygen…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['2,660 g, 8,710 kcal', '2,500 g, 8,500 kcal', '2,550 g, 9,100 kcal', '2,400 g, 8,200 kcal', '2,800 g, 8,800 kcal', '3,000 g, 10,000 kcal', '2,600 g, 8,650 kcal', '2,700 g, 8,900 kcal', '2,750 g, 9,250 kcal', '2,800 g, 9,000 kcal']\",\"question\":\"(a) If a rocket were fueled withkerosineand liquid oxygen, what weight of oxygen would be required for every liter of kerosine ? (Assumekerosineto have the average composition of n-C_14H_30 and a density of 0.764 g/ml). (b) How much energy would be required to fragment the molecules in one liter ofkerosine? (Assume 157 kcal mole for each -CH_2- group and 186 kcal mole for each -CH_3- group.)\",\"src\":\"stemez-OrganicChemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}