{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"17976cf6-3233-57bf-b02c-bc7f0768f7c2","task_key":"all--test--17976cf6-3233-57bf-b02c-bc7f0768f7c2","task_revision_id":"1","upstream_id":"","short_description":"A debtor owed a creditor $12,000 under a promissory note. Under the applicable…","config":"all","split":"test","body":"{\"choices\":\"['On June 1 the creditor became entitled to a judgment against the debtor for $5,000 only.', 'On July 1, not June 1, the creditor became entitled to a judgment against the debtor for $5,000 only.', 'On July 1, not June 1, the creditor will be entitled to a judgment against the debtor for$12,000.', 'The creditor is not entitled to anything, on either June 1 or on July 1.']\",\"question\":\"A debtor owed a creditor $12,000 under a promissory note. Under the applicable statute of limitations, a suit to collect on the promissory note had to have been filed by September 30 of last year. On June 1 of this year, the creditor received a letter from the debtor stating, \\\"I shall pay you $5,000 on July 1 in full satisfaction of what I owe you. \\\" However, the debtor failed to make the payment on July 1. If, on August 1, the creditor brings suit against the debtor and the debtor asserts the statute of limitations as an affirmative defense and refuses to pay the creditor anything, which of the following accurately states the creditor's legal rights against the debtor?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}