{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dd0ac2b9-2324-5eb3-a119-c1682da6b1bc","task_key":"default--test--2919","task_revision_id":"1","upstream_id":"2919","short_description":"Within a cell, the amount of protein synthesized using a given mRNA molecule…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The amount of protein synthesized is determined by the rate of cell division.', 'The age of the cell will determine how much protein is synthesized.', 'The amount of protein synthesized is determined by the amount of DNA replication.', 'The location and number of ribosomes in a cell will solely determine how much protein is synthesized.', 'The type of cell will solely determine how much protein is synthesized.', 'DNA methylation suppresses the expression of genes.', 'The size of the nucleus will determine how much protein is synthesized.', 'The number of chromosomes in a cell determines how much protein is synthesized.', 'Transcription factors mediate the binding of RNA polymerase and the initiation of transcription, which will determine how much protein is manufactured.', 'The speed with which mRNA is degraded will determine how much protein is synthesized.']\",\"question\":\"Within a cell, the amount of protein synthesized using a given mRNA molecule depends in part on which of the following?\",\"src\":\"ori_mmlu-high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}