{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"32345ccf-3401-53d3-994e-a1f85dce2371","task_key":"default--test--2920","task_revision_id":"1","upstream_id":"2920","short_description":"Which of the following would most likely describe the fate of a vesicle formed…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The vesicle remains intact and floats freely in the cytoplasm.', 'The vesicle merges with a Golgi apparatus.', 'The vesicle merges with a mitochondrion.', 'The vesicle fuses with the cell membrane and its contents are expelled out of the cell.', 'The vesicle breaks down on its own without merging with any other organelle.', 'The vesicle merges with a lysosome.', 'The vesicle releases its contents to the cytoplasm to be digested.', 'The vesicle is absorbed by the endoplasmic reticulum.', 'The vesicle is shuttled to the nucleus, and its contents become part of the nucleolus.', 'The vesicle merges with a peroxisome.']\",\"question\":\"Which of the following would most likely describe the fate of a vesicle formed as a result of phagocytosis?\",\"src\":\"ori_mmlu-high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}