{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3dfb4496-29f1-5ea0-b510-cf0cf9779e07","task_key":"all--test--3dfb4496-29f1-5ea0-b510-cf0cf9779e07","task_revision_id":"1","upstream_id":"","short_description":"The normal pH of the cytosol is about 7.2. Most enzymes in the lysosome,…","config":"all","split":"test","body":"{\"choices\":\"['only acidic substances can undergo enzymatic processing in lysosomes', 'most enzymes in the lysosome are incapable of catalyzing substrates inside the lysosome', 'enzymes in the lysosome are released to the cytosol', 'protons are actively pumped into the lysosome']\",\"question\":\"The normal pH of the cytosol is about 7.2. Most enzymes in the lysosome, however, are only active at a pH of 5. This suggests that\",\"subject\":\"high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}