{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6ce8eb94-1f53-5fdb-8f1d-e7b8819b0f26","task_key":"default--test--3009","task_revision_id":"1","upstream_id":"3009","short_description":"Monoploidlines of many species exist. Plant breeders often convert these to…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Plant breeders can control the euploidy of their nuclei, produce genetically pure organisms, develop disease resistant strains of plants, produce larger fruits and flowers, and convert a sterile species hybrid into a fertile double diploid.', 'The treatment can extend the natural lifespan of plants indefinitely', 'Colchicine treatment can make plants immune to all diseases', 'The treatment results in plants that can survive in zero-gravity environments', 'Plant breeders can create new species', 'The treatment can make plants change color spontaneously', 'Colchicine treatment can eliminate the need for sunlight in plant growth', 'Colchicine treatment can convert diploids to monoploids', 'Colchicine treatment can make plants resistant to all herbicides', 'Colchicine treatment increases the speed of plant growth exponentially']\",\"question\":\"Monoploidlines of many species exist. Plant breeders often convert these to diploids orpolyploidsthroughcolchicine treatment. Can you see any advantages to this?\",\"src\":\"stemez-Genetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}