{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3253e2bb-af06-5318-bf76-edd15582003f","task_key":"default--test--921","task_revision_id":"1","upstream_id":"921","short_description":"An avid baseball fan learned that a local professional baseball club was…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"[\\\"Yes, because the club did not incur any cost related to the fan's participation.\\\", 'Yes, under the doctrine of frustration of purpose.', 'No, because the club had already invested in resources for the camp.', 'No, because the fan knew the risks when he signed the contract.', \\\"No, because the fan's death was not the club's responsibility.\\\", 'No, because under the terms of the agreement the $2,500 entrance fee was nonrefundable.', 'No, but only if the club can show that before the start of the baseball camp it rejected another applicant because of its commitment to the fan.', 'Yes, if the club can fill the spot with another attendee.', \\\"Yes, because the club would otherwise be unjustly enriched at the fan's expense.\\\", \\\"Yes, because the fan didn't receive the service he paid for.\\\"]\",\"question\":\"An avid baseball fan learned that a local professional baseball club was conducting a baseball camp for fans who wanted to meet and receive instruction from the club's players. The cost of the two-week camp was advertised for $2,500, which included meals and housing. The fan, a 54-year-old salesman, forwarded the club a $50 registration deposit, which reserved him a spot in the baseball camp. Thereafter, the fan received a contract from the club, which all baseball camp attendees were required to sign. The agreement provided that the $2,500 entrance fee was nonrefundable. According to the agreement, all attendees would receive group instruction during the baseball camp. Consequently, the club's operating costs would not be reduced if one or more of the attendees failed to participate or complete the two-week program. The fan signed the contract and forwarded it with his $2,500 entrance fee to the club. Two days before the start of the baseball camp, however, the fan died from a heart attack. In a restitutionary action, can the executor of the fan's estate, a surviving brother, recover on behalf of the estate either all or part of the $2,500 paid to the club?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}