{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0c104b8c-514f-50df-bf72-49049df66e2f","task_key":"default--test--3208","task_revision_id":"1","upstream_id":"3208","short_description":"Which of the following is most correct concerning cell differentiation in…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Differences between tissues result from spontaneous morphogenesis.', 'Differences in the timing and expression levels of different genes leads to structural and functional differences.', 'Cells in different tissues contain different sets of genes, leading to structural and functional differences.', 'Differences in the reading frame of mRNA leads to structural and functional differences.', 'All cells in vertebrates differentiate identically, there are no structural or functional differences.', 'Differences in the timing and levels of RNA transcription leads to structural and functional differences.', 'Differences between tissues result from spontaneous mutations.', 'Differences in the structure of the cell nucleus leads to structural and functional differences.', 'Differences in the timing of protein synthesis leads to structural and functional differences.', 'Cells in the same tissues contain different sets of genes, leading to structural and functional differences.']\",\"question\":\"Which of the following is most correct concerning cell differentiation in vertebrates?\",\"src\":\"ori_mmlu-high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}