{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"347f1eab-0e74-5460-8651-92ef70a1fc24","task_key":"default--test--1265","task_revision_id":"1","upstream_id":"1265","short_description":"During a paternity trial, the mother's attorney asks to have the baby girl, now…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['permit the child to be exhibited as a non-objectionable form of demonstrative evidence.', \\\"not permit the child to be exhibited, because such an exhibition would violate the child's rights.\\\", 'not permit the child to be exhibited, because such an exhibition would be self-serving to the complainant.', 'not permit the child to be exhibited, because such an exhibition would be highly prejudicial to the defendant.', 'permit the child to be exhibited as within the hearsay exception of pedigree.', 'not permit the child to be exhibited, as it could emotionally distress the child.', 'permit the child to be exhibited, but only under specific conditions set by the court.', 'permit the child to be exhibited, as it may provide relevant evidence to the jury.', 'not permit the child to be exhibited, as the physical resemblance is not a scientifically reliable form of evidence.', 'permit the child to be exhibited, but only if both parties agree to it.']\",\"question\":\"During a paternity trial, the mother's attorney asks to have the baby girl, now 36 months old, exhibited for the purpose of calling attention to certain facial resemblances between the child and the reputed father. The defendant's attorney objects to the offering of the baby into evidence for comparison. The trial judge should\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}