{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"81a460d8-b403-519c-adf3-174fbf98f154","task_key":"all--test--81a460d8-b403-519c-adf3-174fbf98f154","task_revision_id":"1","upstream_id":"","short_description":"Each year, the local boys' and girls' club sponsors a \"Baseball Card Bonanza. \"…","config":"all","split":"test","body":"{\"choices\":\"['Yes, because the collector did not disclose the true value of the card.', 'Yes, because the boy was the true owner of the card and was entitled to the benefit of the bargain.', 'No, because the collector made no false representations of fact.', \\\"No, because the boy was not justified in relying on the collector's offer.\\\"]\",\"question\":\"Each year, the local boys' and girls' club sponsors a \\\"Baseball Card Bonanza. \\\" During the three- day event, collectors of baseball cards gather, exchanging and swapping old cards. A boy and a girl, both 12-year-old youngsters at the bonanza, were looking at each other's cards when they were approached by a 32-year-old collector. The collector asked the boy and girl if he could look through their baseball cards. The boy and girl nodded affirmatively. As the collector was flipping through the boy's cards, he found a 1948 card featuring Branch Rickey, the former owner of the Brooklyn Dodgers. The collector, who knew the card was worth more than $500, offered the boy 50 cents for the card. The boy thought the card had very little value because he knew that Rickey was not a major league baseball player. The boy accepted the 50 cents and gave the Rickey baseball card to the collector. The next day the boy found out that the baseball card was worth$600. If the boy asserts a claim against the collector for deceit, will the boy prevail?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}