{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6a6d40fa-de90-52ff-b427-bf9622e9acc1","task_key":"default--test--2906","task_revision_id":"1","upstream_id":"2906","short_description":"Explain what difficulties would arise if messenger RNA molecules were not…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['mRNA would replicate rapidly', 'The cell would use mRNA as a source of energy', 'The cell would lack proteins', 'Cell would enter a state of permanent division', 'mRNA would be transformed into DNA', 'Excess protein production, energy depletion, and potential harm to the cell', 'mRNA would exit the cell and infect neighboring cells', 'Proteins would be broken down into mRNA', 'mRNA would become part of the cell membrane', 'mRNA would bind to lipids and carbohydrates, disrupting cellular metabolism']\",\"question\":\"Explain what difficulties would arise if messenger RNA molecules were not destroyed after they had produced some polypeptide chains.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}