{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e3528865-6ddb-5456-a893-41daebe47845","task_key":"default--test--3127","task_revision_id":"1","upstream_id":"3127","short_description":"Can chromosome instability cause cancer ?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Chromosomal instability prevents cancer.', 'Chromosomal instability is solely caused by the presence of cancer.', 'Chromosomal instability has no link to cancer.', 'Chromosomal instability is only found in benign tumors and not associated with cancerous growths.', 'Chromosomal instability can be reversed, thereby curing cancer.', 'Chromosomal instability protects cells from becoming cancerous by enhancing genetic diversity.', 'Chromosomal instability directly causes cancer.', 'Chromosomal instability is a type of cancer.', 'Chromosomal instability is the result of a healthy immune response to cancer cells.', 'Chromosomal instability may create an environment that is highly susceptible to certain forms of cancer.']\",\"question\":\"Can chromosome instability cause cancer ?\",\"src\":\"stemez-Genetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}