{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"094cb016-5814-56f6-8f45-29affc230073","task_key":"default--test--5985","task_revision_id":"1","upstream_id":"5985","short_description":"Zokro a nongovernmental not-for-profit organization uses the indirect method to…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['Sale of equipment.', 'Depreciation.', 'Increase in accounts payable.', 'Increase in accounts receivable.', 'Decrease in accounts payable.', 'Donation income.', 'Purchase of inventory.', 'Payment of dividends.', 'Payment on long-term debt.', 'Purchase of equipment.']\",\"question\":\"Zokro a nongovernmental not-for-profit organization uses the indirect method to prepare its statement of cash flows. In determining its net cash provided (used) by operating activities Sokro must add back which of the following to the change in net assets?\",\"src\":\"ori_mmlu-professional_accounting\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}