{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4ba88800-3e90-5188-902d-8bdacc835c11","task_key":"default--test--3357","task_revision_id":"1","upstream_id":"3357","short_description":"What is anoncogene?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Oncogenes are found only in viruses', 'Oncogenes prevent cancer cells', 'Oncogenes are a type of immune cell', 'Oncogenes detoxify harmful substances in the cell', 'Oncogenes slow down cell division', 'Oncogenes are produced exclusively by healthy cells', 'Oncogenes are inactive segments of DNA', 'Oncogenes repair damaged DNA', 'Oncogenes may cause cells to become cancerous', 'Oncogenes lead to faster cell death']\",\"question\":\"What is anoncogene?\",\"src\":\"stemez-Genetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}