{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e1683165-492c-5ab0-b708-f02d5bc79d4f","task_key":"all--test--e1683165-492c-5ab0-b708-f02d5bc79d4f","task_revision_id":"1","upstream_id":"","short_description":"Which one sentence explains most accurately why spin trapping is often used to…","config":"all","split":"test","body":"{\"choices\":\"['spin trapping provides more structural information than direct detection by EPR', 'spin trapping makes it easy to quantify free radical intermediates', 'steady state concentration of free radical intermediates is often too low to enable direct detection by EPR', 'detection of spin adducts requires lower power than direct detection of radical intermediates']\",\"question\":\"Which one sentence explains most accurately why spin trapping is often used to detect free radical intermediates?\",\"subject\":\"college_chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}