{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"99f8b1b1-0417-5ebd-9d04-d3ed658532b8","task_key":"all--test--99f8b1b1-0417-5ebd-9d04-d3ed658532b8","task_revision_id":"1","upstream_id":"","short_description":"A man and a school entered into a written contract providing that the man would…","config":"all","split":"test","body":"{\"choices\":\"[\\\"a proper attempt to refresh the headmaster's recollection.\\\", 'a proper attempt to introduce recorded recollection.', \\\"an improper attempt to support the headmaster's credibility.\\\", 'an improper attempt to lead the witness.']\",\"question\":\"A man and a school entered into a written contract providing that the man would be employed for one year in various capacities (athletic director, teacher, football coach) in return for an annual salary of $37,750. Shortly thereafter and prior to the July commencement date of employment, the school elected to terminate its varsity football program. The school publicly attributed the decision to economic factors. Upon hearing this news, the man sought out the headmaster of the school to inquire as to the effect, if any, of this decision on his salary and responsibilities. In order to resolve the matter, the headmaster arranged a meeting among various school officials to discuss the man's situation. Afterward, the school sent written notice to the man of its intent to terminate his employment contract. The man then commenced suit to recover the full balance of his salary calculated on the basis of the contract. At trial, the headmaster was called to testify. On direct examination, he testified that six people (including himself) attended the meeting where it was decided to terminate the man's employment contract. When asked to identify the attendees, the headmaster gave the names of four but, despite trying, was unable to remember the name of the fifth person. The attorney who called the headmaster to testify now seeks to show him her handwritten notes that the attorney prepared during her pretrial interview with the headmaster, in which he provided all five names. The trial court is likely to consider the showing of the notes taken as\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}