{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"29052276-8e46-55fd-9511-637e9f88423c","task_key":"default--test--1395","task_revision_id":"1","upstream_id":"1395","short_description":"A doctor who was licensed to practice medicine in a particular state was…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"[\\\"The doctor's conviction in state court is enough evidence of his guilt, and a hearing before the board would be redundant and unnecessary.\\\", \\\"The adjudicative facts necessary to revoke the doctor's license were determined in the criminal trial, and therefore due process does not require any further trial-type hearing.\\\", \\\"The board's decision to revoke the doctor's license without a hearing is justified because of the severe nature of the doctor's crime.\\\", \\\"The licensing board was required to summarily revoke the doctor's license because Article IV, Section 1, of the Constitution requires the licensing board to give full faith and credit to the doctor's criminal conviction.\\\", \\\"The medical board was merely following state law, which requires revocation of a doctor's license in such cases.\\\", \\\"Due process requires a balancing of interests, and the state's interest in preventing drug abuse outweighs the doctor's interest in the particular procedure followed in the disciplinary proceeding.\\\", 'The medical board has an obligation to protect the public from doctors who abuse their prescription-writing privileges, and a hearing would delay necessary action.', \\\"The doctor has already had a fair trial in a court of law, and the board's hearing would not change the outcome of that trial.\\\", \\\"The doctor's admission of the conviction and its factual basis eliminates the need for a hearing before the board.\\\", \\\"A doctor's license to practice is a privilege, not a right, and therefore is not property within the meaning of the due process clause of the Fourteenth Amendment.\\\"]\",\"question\":\"A doctor who was licensed to practice medicine in a particular state was convicted in state court of improperly distributing specified drugs by writing prescriptions for fictitious persons. Under state law, such an abuse of the prescription-writing privilege requires revocation of a doctor's license. After it received an official notification of the doctor's conviction, the state medical board revoked the doctor's license without affording the doctor any opportunity for a hearing. The doctor has sued the board in state court to set aside the revocation, alleging deprivation of property without due process of law because the board did not provide an opportunity for a trial-type hearing before revoking the license. The doctor does not deny the conviction or the factual basis for it. Which of the following is the strongest argument in support of the state medical board?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}