{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"38ff310d-e6f1-5c53-b2bd-010c3dccac2b","task_key":"default--test--5273","task_revision_id":"1","upstream_id":"5273","short_description":"Rune Co.'s checkbook balance on December 31 was $10000. On that date Rune held…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['$10,000', '$12,000', '$8,000', '$16,000', '$15,000', '$9,000', '$7,000', '$13,000', '14000', '$11,000']\",\"question\":\"Rune Co.'s checkbook balance on December 31 was $10000. On that date Rune held the following items in its safe: $4000 check payable to Rune postdated January 3 and not included in the December 31 checkbook balance in collection of a sale made in December. $1000 check payable to Rune deposited December 15 and included in the December 31 checkbook balance but returned by the bank on December 30 stamped \\\"NSF\\\". The check was redeposited on January 2 and cleared on January 9. What amount should Rune report as cash in its December 31 balance sheet?\",\"src\":\"ori_mmlu-professional_accounting\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}