{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"108e8e3a-182a-5bd8-a14f-88d2718935fe","task_key":"default--test--2871","task_revision_id":"1","upstream_id":"2871","short_description":"Which of the following statements concerning the Golgi apparatus of a eukaryote…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['It is typically associated with small secretory vesicles located near its cis face.', \\\"Glycosylation of certain secretory proteins occurs prior to the protein's entry into its lumen.\\\", 'It is typically associated with large lysosomes located near its trans face.', 'Its trans face is closest to the endoplasmic reticulum.', 'It is located in the nucleus of the cell.', 'It is responsible for the synthesis of ATP.', 'Its cisternae are not involved in protein processing.', 'Its composite flattened cisternae are continuous with one another.', 'Glycosylation of certain proteins occurs outside the Golgi apparatus.', 'It is oriented in the cytoplasm so that its cis face is closest to the endoplasmic reticulum.']\",\"question\":\"Which of the following statements concerning the Golgi apparatus of a eukaryote is correct?\",\"src\":\"ori_mmlu-college_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}