{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7c5ca971-ed3e-5872-b91f-33c795b318e9","task_key":"default--test--1350","task_revision_id":"1","upstream_id":"1350","short_description":"A state law required vacant public school buildings to be sold at auction to the…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['No, because the law would be favoring one religious institution over others, thereby violating the First Amendment.', 'No, because the law would violate the separation of church and state as stipulated in the First Amendment.', 'No, because a statute specially authorizing the sale of the building without competitive bidding would violate the equal protection clause of the Fourteenth Amendment.', 'Yes, because the law would not primarily or substantially support the religious activities of the church.', 'No, because the law would infringe on the rights of other potential bidders who could offer a higher price for the building.', \\\"Yes, because the church's use of the building for educational purposes would not constitute an establishment of religion.\\\", 'Yes, because the law would be a fair and equitable solution to a local problem.', 'No, because the transfer of the building to the church under these circumstances would constitute an establishment of religion prohibited by the First and Fourteenth Amendments.', 'Yes, because the law would be supporting education, not religion.', 'Yes, because surplus government property is not subject to the limitations imposed by the establishment clause as incorporated into the establishment clause as incorporated into the Fourteenth Amendment.']\",\"question\":\"A state law required vacant public school buildings to be sold at auction to the highest bidder. A church in a city located in the state wanted to acquire larger facilities for its school. The city's school board proposed a new state law that would authorize it to sell a vacant public school building, at a price below its fair market value, to the church for use as its school. If enacted, would this law be constitutional?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}