{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4da913e0-832c-5d42-b608-85f688b33d9c","task_key":"default--test--2901","task_revision_id":"1","upstream_id":"2901","short_description":"What are the major forces of evolution?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['reproduction, migration, mutation, natural selection', 'mutation, genetic drift, migration, genetic hitchhiking', 'mutation, genetic drift, migration, random mating', 'mutation, gene flow, migration, natural selection', 'adaptation, genetic drift, migration, natural selection', 'mutation, genetic drift, movement, natural selection', 'mutation, genetic drift, migration, sexual selection', 'mutation, genetic drift, natural selection, artificial selection', 'mutation, genetic shift, migration, natural selection', 'mutation, genetic drift, migration, natural selection']\",\"question\":\"What are the major forces of evolution?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}