{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5784af68-e4fd-59c4-8f79-0bc10a3c6bda","task_key":"default--test--4932","task_revision_id":"1","upstream_id":"4932","short_description":"How were the royal cemeteries of the Moche discovered?","config":"default","split":"test","body":"{\"category\":\"history\",\"options\":\"['A forest fire burned away the dense vegetation that concealed the cemetery.', 'Thieves raiding the tombs were caught by the police.', 'Archaeologists discovered an exact replica of the city in the map room.', 'The cemeteries were revealed after a massive earthquake.', 'A flock of sheep that had been living there fell into a tomb.', 'A local farmer stumbled upon the tombs while tilling his field.', 'Local legends led archaeologists to the exact location of the cemeteries.', 'A drought caused the water level to decrease, revealing the tombs.', 'They were discovered during an archaeological expedition funded by the government.', 'The cemeteries were accidentally discovered during a construction project.']\",\"question\":\"How were the royal cemeteries of the Moche discovered?\",\"src\":\"ori_mmlu-prehistory\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}