{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1fc8d5dc-7d17-53f7-b7c1-1da88e00b902","task_key":"default--test--4866","task_revision_id":"1","upstream_id":"4866","short_description":"What is the evidence for trade between Indus Valley cities and the city states…","config":"default","split":"test","body":"{\"category\":\"history\",\"options\":\"['Mesopotamian cuneiform tablets have been discovered in the Indus Valley.', 'All of the above.', 'Harappan coins have been found in Mesopotamia, and Mesopotamian coins have been found in the Indus Valley.', 'Obsidian tools have been found at sites in both regions.', 'Harappan seals have been found in Mesopotamia and Mesopotamian cylinder seals have been found in the Indus valley.', 'Pottery styles similar to those found in Mesopotamia have been discovered in the Indus Valley.', 'Archaeological evidence shows that there was no trade between the two regions.', 'Stone axes from the Indus Valley have been found in Mesopotamia.']\",\"question\":\"What is the evidence for trade between Indus Valley cities and the city states of ancient Mesopotamia?\",\"src\":\"ori_mmlu-prehistory\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}