{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"30fb674a-d781-508d-b303-6ef9209ed7eb","task_key":"default--test--3043","task_revision_id":"1","upstream_id":"3043","short_description":"Describe the structure and function of the nuclear membrane.","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The nuclear membrane is a single layer structure', 'The nuclear membrane has no connection with the endoplasmic reticulum', 'The nuclear pores facilitate the movement of large particles only, such as whole organelles', 'The nuclear membrane dissolves during interphase and reforms during mitosis', 'The nuclear membrane is a continuous extension of the plasma membrane', 'The nuclear pores are closed structures', 'The nuclear membrane is composed of a single phospholipid bilayer with no associated proteins', 'The nuclear membrane contains no pores, instead relying on transport proteins embedded in the membrane for substance exchange', 'The nuclear membrane consists of two leaflets of membrane, one facing the nucleus and the other facing the cytoplasm, and has many nuclear pores which provide a means for nuclear-cytoplasmic communication.', 'The nuclear membrane is completely impermeable, blocking all substances from entering or exiting the nucleus']\",\"question\":\"Describe the structure and function of the nuclear membrane.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}