{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4d4776ee-30e7-5358-8bd3-8c8bc7a3c6d8","task_key":"all--test--4d4776ee-30e7-5358-8bd3-8c8bc7a3c6d8","task_revision_id":"1","upstream_id":"","short_description":"During a paternity trial, the mother's attorney asks to have the baby girl, now…","config":"all","split":"test","body":"{\"choices\":\"['permit the child to be exhibited as a non-objectionable form of demonstrative evidence.', 'not permit the child to be exhibited, because such an exhibition would be highly prejudicial to the defendant.', 'permit the child to be exhibited as within the hearsay exception of pedigree.', 'not permit the child to be exhibited, because such an exhibition would be self-serving to the complainant.']\",\"question\":\"During a paternity trial, the mother's attorney asks to have the baby girl, now 36 months old, exhibited for the purpose of calling attention to certain facial resemblances between the child and the reputed father. The defendant's attorney objects to the offering of the baby into evidence for comparison. The trial judge should\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}