{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0d79fcb5-9609-5d3c-bb86-b3fec96c44c6","task_key":"default--test--3232","task_revision_id":"1","upstream_id":"3232","short_description":"Why is it incorrect to say that man evolved from monkeys? What did he possibly…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Man evolved directly from monkeys', 'Man evolved from a branch of primates that includes the modern lemur', 'Man evolved from Parapithecus', 'Man evolved from a direct line of increasingly intelligent monkeys', 'Man evolved from Neanderthals who were a separate species from monkeys', 'Man evolved from the same ancestor as the marsupials', 'Monkeys, man, and apes all evolved from a common ancestor independently. The most likely ancestor of the chimpanzee, gorilla, orangutan and man is Dryopithecus.', 'Man evolved from an ancient reptilian species that also gave rise to monkeys', 'Man and monkeys share a direct ancestor in the modern baboon', 'Man evolved from the gibbon']\",\"question\":\"Why is it incorrect to say that man evolved from monkeys? What did he possibly evolve from?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}