{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6987bbf8-6e03-5bfb-9785-44741db5ae2b","task_key":"default--test--1412","task_revision_id":"1","upstream_id":"1412","short_description":"In the absence of a provision to the contrary in the articles of incorporation,…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['can be removed from office at a meeting of the shareholders, but only for cause and after an opportunity to be heard has been given to the directors.', 'can be removed from office at a meeting of the shareholders, but only with a two-thirds majority vote.', 'can be removed from office only by a unanimous vote of the shareholders, with or without cause.', 'cannot be removed from office prior to the expiration of their term.', 'can be removed from office at a meeting of the shareholders, but only if they fail to attend three consecutive meetings without a reasonable excuse.', 'can be removed from office at a meeting of the shareholders, but only if a replacement director has been identified.', 'can be removed from office at a meeting of the shareholders, with or without cause.', 'can be removed from office at a meeting of the shareholders, but only for cause.', 'can only be removed from office by the board of directors, not the shareholders.', 'can be removed from office prior to the expiration of their term only by a decree of the circuit court in an action by the shareholders.']\",\"question\":\"In the absence of a provision to the contrary in the articles of incorporation, the directors of a corporation elected for a specified term \",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}