{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"300cb5d2-e6c4-55c5-a217-878f5e666315","task_key":"default--test--5987","task_revision_id":"1","upstream_id":"5987","short_description":"Which of the following statements regarding an individual’s suspended passive…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['Suspended losses can only be utilized against active income, not portfolio income.', 'Suspended losses must be carried forward five years and back two years.', 'A maximum of 75% of the suspended losses can be used each year when an election is made to forgo the carryback period.', 'Suspended losses must be carried back three years and forward seven years.', 'Suspended losses can be carried forward, but not back, until utilized.', 'Suspended losses can be carried back three years, but not forward.', '$3,000 of suspended losses can be utilized each year against portfolio income.', 'A maximum of 50% of the suspended losses can be used each year when an election is made to forgo the carryback period.', 'Only 25% of the suspended losses can be used each year without any carryback or carryforward period.', 'Suspended losses can be carried back and forward indefinitely until utilized.']\",\"question\":\"Which of the following statements regarding an individual’s suspended passive activity losses is correct?\",\"src\":\"ori_mmlu-professional_accounting\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}