{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"80c8d3df-70de-599c-98aa-0e38de60514b","task_key":"all--test--80c8d3df-70de-599c-98aa-0e38de60514b","task_revision_id":"1","upstream_id":"","short_description":"A university fired its head basketball coach after a series of losing seasons.…","config":"all","split":"test","body":"{\"choices\":\"['Yes, because the university is an intended third-party beneficiary of the contract between the coach and the booster.', \\\"Yes, because the university detrimentally relied on the booster's promise by hiring the coach.\\\", \\\"No, because the booster's promise was, in essence, an illegal form of procurement and void as against public policy.\\\", \\\"No, because the booster's promise was made to the coach rather than to the university and, therefore, was not a charitable subscription.\\\"]\",\"question\":\"A university fired its head basketball coach after a series of losing seasons. The university contacted a coach who had a strong reputation as a person who cottld \\\"turn around\\\" a program and produce winning teams. The university offered the coach an annual salary of $250,000 to coach its basketball team, but the coach declined the offer, hoping to find another institution that would pay him a higher salary. Thereafter, a wealthy booster, who was interested in enhancing the university's basketball program, contacted the coach and told him that if he would sign a coaching contract with the university, the booster would pay him $50,000 a year as an unpublished supplement to his salary. Furthermore, the booster promised to contribute $5,000 to the university athletic fund every time the basketball team won a game under the coach's tutelage. The coach thereupon signed a three-year contract as the head basketball coach at the university at an annual salary of $250,000. During the coach's first year as coach, the university basketball team compiled a record of 18 wins and 12 losses. The booster, however, refused to pay anything to either the coach or the university athletic fund. Assume that the agreement between the coach and the booster does not violate any rule of the university or of any intercollegiate athletic association. The university brought suit against the booster to recover $90,000 for breach of his promise to pay $5,000 into the athletic fund for each game won by the basketball team. Is it likely that the university will prevail in this contract action?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}