{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7edf533f-c206-5c8d-87d4-25b37bb87ef5","task_key":"default--test--3956","task_revision_id":"1","upstream_id":"3956","short_description":"If 1.588 g of nitrogen tetroxide gives a total pressure of 1 atm when partially…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['Degree of dissociation, α: 0.1; Value of K_p: 0.08', 'Degree of dissociation, α: 0.16; Value of K_p: 0.12', 'Degree of dissociation, α: 0.25; Value of K_p: 0.20', 'Degree of dissociation, α: 0.3; Value of K_p: 0.25', 'Degree of dissociation, α: 0.2; Value of K_p: 0.15', 'Degree of dissociation, α: 0.1846; Value of K_p: 0.141', 'Degree of dissociation, α: 0.12; Value of K_p: 0.09', 'Degree of dissociation, α: 0.28; Value of K_p: 0.23', 'Degree of dissociation, α: 0.22; Value of K_p: 0.18', 'Degree of dissociation, α: 0.15; Value of K_p: 0.11']\",\"question\":\"If 1.588 g of nitrogen tetroxide gives a total pressure of 1 atm when partially dissociated in a 500-cm^3 glass vessel at 25°, what is the degree of dissociation, \\\\alpha? What is the value of K_p ? The equation for this reaction is N_2O_4\\\\rightarrow 2NO_2 .\",\"src\":\"stemez-Chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}