{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1cd1f3bf-d336-5478-adc0-cbfdbb38cfab","task_key":"default--test--1099","task_revision_id":"1","upstream_id":"1099","short_description":"Rainbow Corporation has outstanding 1,000 shares of voting common stock and…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['The proposal is invalidly approved because a unanimous vote from both classes is required.', 'The proposal is validly approved because the nonvoting preferred stock does not count towards the vote.', 'The proposal is invalidly approved because a two-thirds vote of each class is required.', 'The vote of the preferred stockholders does not matter because it was nonvoting stock.', 'The proposal is validly approved because the common shareholders have the majority vote.', 'The vote of the preferred stockholders does not matter because the proposal affects the common stock.', 'The proposal is validly approved because the preferred stockholders who voted in favor have a liquidation preference.', 'The proposal is invalidly approved because a majority of the outstanding shares did not approve.', 'The proposal is invalidly approved because a majority of the preferred shareholders did not approve.', 'The proposal is validly approved because overall a majority of the outstanding shares did approve.']\",\"question\":\"Rainbow Corporation has outstanding 1,000 shares of voting common stock and 1,000 shares of nonvoting preferred. The preferred has a liquidation preference equal to its par value of $100 per share plus a 3 percent noncumulative dividend. Rainbow submits to its stockholders a proposal to authorize a new class of preferred stock with redemption rights that would come ahead of the old preferred stock. At a shareholders' meeting, 700 common and 400 preferred vote in favor of the proposal. Which of the following statements is correct?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}