{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a7e20706-dd5b-5be8-911a-2a049b287596","task_key":"default--test--1628","task_revision_id":"1","upstream_id":"1628","short_description":"A state statute provides that the crime of assault is generally punishable by a…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['A judicial finding with substantial evidence.', 'A judicial finding beyond a reasonable doubt.', 'A jury finding by admission of guilt.', 'A jury finding by a preponderance of the evidence.', 'A jury finding beyond a reasonable doubt.', 'A jury finding with clear and convincing evidence.', 'A jury finding with circumstantial evidence.', 'A judicial finding with clear and convincing evidence.', 'A judicial finding by admission of guilt.', 'A judicial finding by a preponderance of the evidence.']\",\"question\":\"A state statute provides that the crime of assault is generally punishable by a maximum of five years in prison. It further provides that the maximum punishment increases to 10 years in prison if the defendant possessed a deadly weapon during the assault. The statute designates the deadly weapon element as a sentencing factor. A defendant charged with assault has pleaded not guilty and has requested a jury trial. The prosecutor has announced that she will be seeking a 10- year sentence based on the defendant's alleged possession of a deadly weapon. What finding regarding the defendant's possession of a deadly weapon is necessary for the court to impose a 10-year sentence?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}