{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2397a6ef-7515-54b1-bda9-b377a9673ec7","task_key":"default--test--6506","task_revision_id":"1","upstream_id":"6506","short_description":"A 33-year-old woman comes to the physician because of a 2-day history of mild…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Insertion of viral promotors adjacent to cellular oncogenes', 'Activation of cellular tumor suppressor genes', 'Non-disjunction of chromosomes during mitosis', 'Inactivation of viral suppressor genes', 'Inactivation of cellular p53', 'Insertion of viral oncogenes into the host genome', 'Transactivation of cellular growth factor genes by TAX', 'Specialized transduction', 'Insertion of viral promotors adjacent to cellular growth factor genes', 'Overexpression of cellular oncogenes']\",\"question\":\"A 33-year-old woman comes to the physician because of a 2-day history of mild nausea, increased urinary urgency and frequency, and constipation. She also has had a 4.5-kg (10-lb) weight loss during the past 2 weeks and a 3-week history of vaginal bleeding. Pelvic examination shows a nodular cervix with an irregular, friable posterior lip, and a rock-hard, irregular, immobile pelvic mass that extends across the pelvis. Examination of biopsy specimens from the cervix and anterior wall of the vagina show well-differentiated keratinizing squamous cell carcinoma. Which of the following best describes the pathogenesis of this patient's disease?\",\"src\":\"ori_mmlu-professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}