{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6a4f235b-5e07-5c22-8be0-5324b2732b34","task_key":"default--test--3010","task_revision_id":"1","upstream_id":"3010","short_description":"How are the variable portions of heavy chains combined to create diversity in…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Only two DNA regions, V and D, combine in heavy chains', 'V, D, and JH regions are combined in light chains', 'V and JH regions are combined, while D regions are excluded from heavy chains', 'Five separate DNA regions are combined in heavy chains, adding extra complexity', 'D and JH regions are combined, while V regions are excluded from heavy chains', 'Four separate DNA regions are combined in heavy chains', 'V, DH, and J regions combine in heavy chains, introducing an incorrect region name', 'Three separate DNA regions, V, D, and JH, must be combined in heavy chains', 'A single DNA region undergoes rearrangement to create diversity in heavy chains', 'V, D, JH, and CH regions are all combined in heavy chains']\",\"question\":\"How are the variable portions of heavy chains combined to create diversity in the antibody sequences?\",\"src\":\"stemez-Genetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}