{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b22a9668-a47c-5cbd-8683-e3667c390425","task_key":"default--test--12055","task_revision_id":"1","upstream_id":"12055","short_description":"Heats of reaction can be calculated from the heats of formationof the reactant…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['158,000 cal/g mol CH_4', '110,000 cal/g mol CH_4', '140,000 cal/g mol CH_4', '144,580 cal/g mol CH_4', '130,200 cal/g mol CH_4', '125,300 cal/g mol CH_4', '165,000 cal/g mol CH_4', '150,250 cal/g mol CH_4', '135,500 cal/g mol CH_4', '120,450 cal/g mol CH_4']\",\"question\":\"Heats of reaction can be calculated from the heats of formationof the reactant and product species. Using the followingheats of formation, calculate the heat of reaction for thecombustion of methane Heats of formation(@ 291 K and 14.7psia) C + 2H_2 \\\\rightharpoonupCH_4(g)\\\\DeltaH_f= 18,240 cal/g mol C + O_2 \\\\rightharpoonupCO_2(g)\\\\DeltaH_f= 94,450 cal/g mol 2H_2 + O_2 \\\\rightharpoonup2H_2O(1)\\\\DeltaHf= 68,370 cal/g mol\",\"src\":\"stemez-Thermodynamics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}