{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a247d6d1-c5e2-590f-81ea-f0349b33d1cb","task_key":"default--test--3876","task_revision_id":"1","upstream_id":"3876","short_description":"The single DNA molecule in an E. coli chromosome (MW = 2.80 × 10^9) contains…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['720 times as long as the cell', '850 times as long as the cell', '700 times as long as the cell', '500 times as long as the cell', '900 times as long as the cell', '765 times as long as the cell', '600 times as long as the cell', '800 times as long as the cell', '550 times as long as the cell', '665 times as long as the cell']\",\"question\":\"The single DNA molecule in an E. coli chromosome (MW = 2.80 × 10^9) contains about 4.5 million mononucleotide units which are spaced about 3.4 \\\\AA apart. Calculate the total length of this DNA molecule and compare it with the length of the E. coli cell.\",\"src\":\"stemez-Chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}