{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5600eed1-9709-53c9-b354-996d602282e4","task_key":"all--test--5600eed1-9709-53c9-b354-996d602282e4","task_revision_id":"1","upstream_id":"","short_description":"A recent law school graduate took and passed the bar examination. Before the…","config":"all","split":"test","body":"{\"choices\":\"['constitutional, because juveniles are entitled to the equal protection of the laws.', 'constitutional, because the state has a strong and legitimate interest in rehabilitating juvenile offenders, and this is furthered by protecting them from embarrassment in later life through revelation ofjuvenile offenses.', 'unconstitutional, because the bar examiners, as a quasi-judicial agency, is entitled to haveaccess to all relevant public documents.', 'unconstitutional, because it hinders the interests of justice by preventing the bar examiners from determining the fitness of candidates to practice law.']\",\"question\":\"A recent law school graduate took and passed the bar examination. Before the swearing-in ceremony, however, the graduate received a letter from the bar examiners indicating that his admission would be delayed until a character fitness investigation had been completed. The examiners also requested information as to whether the graduate had ever been arrested, convicted, or placed on probation for a criminal offense. The graduate had been arrested as a juvenile for possession of marijuana. He was placed in a special drug education program for first- time juvenile offenders and was told that the arrest would be expunged. Since the graduate believed that he had been totally exonerated of criminal liability, he didn't report the arrest on his bar application form. The bar examiners had, in fact, received an anonymous letter making reference to the graduate's juvenile arrest and suggesting that he was not morally fit to be admitted as an attorney. In addition, the letter provided detailed information about the facts related to the offense. As a result, the examiners hired a special investigator, to look into the matter. As part of the investigator's inquiry, he went to the clerk of the juvenile court where the offense occurred and demanded access to the records concerning the graduate. The clerk refused, citing a state statute that required all court and police records relating to juveniles be sealed. After all other attempts to gain access to the records proved futile, the bar examiners filed suit in federal district court demanding access to the relevant documents. The court should rule that, as applied to this case, the state statute regarding the sealing of juvenile records is\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}