{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"450b555a-053f-5437-8e41-658f45a0601a","task_key":"default--test--5775","task_revision_id":"1","upstream_id":"5775","short_description":"On January 1 the partners' interest in capital profits and losses of Studio…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['Studio terminated as of January 1.', 'Studio terminated as of the date of the next partnership meeting.', 'Studio terminated when Stone left the partnership.', 'Studio did not terminate.', 'Studio did not terminate but was restructured.', 'Studio terminated as of April 9.', 'Studio terminated as of December 31.', 'Studio terminated when Taylor acquired more than 50% interest.', 'Studio terminated as of the end of the fiscal year.', 'Studio did not terminate but was required to revalue its assets.']\",\"question\":\"On January 1 the partners' interest in capital profits and losses of Studio Partnership were: Partners Percentages Ross 15% Stone 35% Taylor 50% On April 9 Stone sold his entire interest to Taylor. For tax purposes which of the following statements is correct regarding Studio's status as a partnership?\",\"src\":\"ori_mmlu-professional_accounting\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}