{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6b7d0cc9-dd23-5bd3-a2d1-ba8949c8f69c","task_key":"default--test--1214","task_revision_id":"1","upstream_id":"1214","short_description":"A landlord owned a large building in the city. On January iS, the landlord…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['The landlord may only recover against the health club for past rent due.', 'The landlord may recover against the health club for past rent due.', 'The landlord may recover against the tenant and the health club, jointly and severally, for past rent due.', 'The landlord may recover against the health club and the corporation, but not the tenant, for past rent due.', 'The landlord may only recover against the corporation for past rent due.', 'The landlord may recover against the tenant and the corporation, jointly and severally, for past rent due.', 'The landlord may recover against the corporation for past rent due.', 'The landlord may recover against the tenant for past rent due.', 'The landlord cannot recover against anyone for past rent due.', 'The landlord may recover against the corporation and the health club, jointly and severally,for past rent due.']\",\"question\":\"A landlord owned a large building in the city. On January iS, the landlord leased the building to atenant for a period of 20 years at a rental of $10,000 per month. The leasehold agreement between the landlord and tenant provided that the latter was not permitted \\\"to assign this lease to anyone except a corporation with an €˜A' credit rating from a well- known credit rating company. \\\" On February 1 of the following year, the tenant leased the premises to a corporation that did not have the required credit rating. The tenant €”corporation lease was for a period of five years, with a rental of $15,000 per month, payable by the corporation to the tenant. In addition, the corporation agreed to abide \\\"by all of the terms and conditions of the lease between the landlord and the tenant. \\\"One year later, the corporation leased the premises to a health club for the balance of the term of the corporation €”tenant lease. The health club owner took possession of the said premises on February 1, the same day that the corporation vacated its occupancy. Pursuant to the corporation €”health club leasehold agreement, the latter was obligated to pay a monthly rental of $17,500 directly to the corporation. The health club has a €˜B' credit rating with the well-known credit rating company. For one year, the health club paid $17,500, each month directly to the corporation. During that same period, the corporation continued to pay $15,000 each month to the tenant, while the latter paid $10,000 (each month) to the landlord. The landlord knew about the leases to the corporation and the health club and protested promptly, but took no further action, apparently satisfied as long as he received his $10,000 per month from the tenant. Thereafter, the health club abandoned the premises and stopped paying rent to the corporation. After the health club discontinued paying rent, the corporation stopped paying rent to the tenant. When the tenant failed to receive his rent, he, too, stopped paying rent to the landlord. If the landlord brings suit to recover for past rent due, which of the following is most accurate?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}