{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"80746a94-8b6b-5eec-88a1-a95f62e8c85f","task_key":"default--test--3266","task_revision_id":"1","upstream_id":"3266","short_description":"Crossing-over during meiosis permits scientists to determine","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['the rate of mutations', 'the chance for variation in zygotes', 'the age of an organism', 'the potential for genetic disorders', 'the sequence of DNA bases', 'the rate of cell division', 'the number of chromosomes in a cell', 'which traits are dominant or recessive', 'the sex of an organism', 'the distance between genes on a chromosome']\",\"question\":\"Crossing-over during meiosis permits scientists to determine\",\"src\":\"ori_mmlu-high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}