{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"85f3dd15-640a-52d2-b716-9c4dbee578d8","task_key":"all--test--85f3dd15-640a-52d2-b716-9c4dbee578d8","task_revision_id":"1","upstream_id":"","short_description":"A man claims to have inherited property from a wealthy businessman. The man's…","config":"all","split":"test","body":"{\"choices\":\"['admissible, only if the photographer is available to testify concerning the circumstances under which the photograph was taken.', 'admissible, only if a witness verifies that it is a correct and accurate representation of the relevant facts.', 'inadmissible as non-verbal hearsay not within any recognized exception.', 'inadmissible as not the best evidence.']\",\"question\":\"A man claims to have inherited property from a wealthy businessman. The man's birth certificate shows that he was born out of wedlock. The record of a proceeding for a support order shows that the businessman was adjudged to be father of the man. However, the man can establish his status as heir of the businessman only if he was legitimated by the marriage of his mother and the businessman subsequent to his birth. Thus, the man must prove that this marriage occurred. The man's attorney has not been able to discover any marriage license or certificate. However, the attorney does have a photograph that shows a couple dressed in wedding clothes. The scene is the front of a church. Bystanders are seen to be throwing rice at the couple and they seem to be responding by smiling and bowing down. The attorney was given the photograph by the man. He found it in his mother's effects following her death. The man believes that the bride in the picture is his mother. He cannot identify the groom. The attorney was informed by a former acquaintance of the businessman who has seen the snapshot that he thinks the groom is the businessman. If the attorney seeks to introduce the photograph as proof that the mother and the businessman were married, the trial judge should rule the photograph\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}