{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7ec360ac-df9d-5883-bdc9-21b4467f35fb","task_key":"default--test--2852","task_revision_id":"1","upstream_id":"2852","short_description":"Describe the structure and function of the nuclear membrane.","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The nuclear membrane functions independently of the endoplasmic reticulum and the Golgi apparatus', 'The nuclear membrane is a single-leaflet structure', 'The nuclear membrane consists of two leaflets of membrane, with nuclear pores providing a means for nuclear-cytoplasmic communication.', 'The nuclear membrane contains chlorophyll for photosynthesis', 'The nuclear membrane has a single layer that fuses with the endoplasmic reticulum', 'The nuclear membrane is free of pores', 'The nuclear membrane is a rigid, impermeable barrier around the nucleus', 'The nuclear membrane is completely permeable, allowing all substances to pass freely', 'The nuclear membrane has no communication with the cytoplasm', 'The nuclear membrane disassembles during cell division and is not reformed afterward']\",\"question\":\"Describe the structure and function of the nuclear membrane.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}