{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"378b3b87-dbce-59ac-bb7c-d3bb88a3fb6f","task_key":"default--test--4084","task_revision_id":"1","upstream_id":"4084","short_description":"Which one sentence explains most accurately why spin trapping is often used to…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['spin trapping can be used to create a visual representation of free radical intermediates', 'spin trapping can be used to manipulate the properties of free radical intermediates', 'spin trapping makes it easy to quantify free radical intermediates', 'steady state concentration of free radical intermediates is often too low to enable direct detection by EPR', 'detection of spin adducts requires lower power than direct detection of radical intermediates', 'spin trapping does not require specialized equipment for detection', 'spin trapping can be used to change the state of free radical intermediates', 'spin trapping allows for longer observation periods of free radical intermediates', 'spin trapping provides more structural information than direct detection by EPR', 'spin adducts can be stored and analyzed at a later date']\",\"question\":\"Which one sentence explains most accurately why spin trapping is often used to detect free radical intermediates?\",\"src\":\"ori_mmlu-college_chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}