{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"538c5f16-fec3-5819-813e-9bbf5c6c97c2","task_key":"default--test--2996","task_revision_id":"1","upstream_id":"2996","short_description":"In an experiment, the first cleavage plane of an amphibian zygote was…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Both blastomeres will form incomplete embryos.', 'The blastomere without the gray crescent will form a complete, but small, embryo.', 'The blastomere with the gray crescent will grow in size more quickly than the one without the gray crescent.', 'The blastomere without the gray crescent will stop dividing and die before the second cleavage.', 'The blastomere with the gray crescent will form an abnormal embryo.', 'The blastomere with the gray crescent will form a complete, but small, embryo.', 'The blastomere without the gray crescent will form a complete, but abnormal, embryo.', 'The blastomere without the gray crescent will grow in size more quickly than the one with the gray crescent.', 'Both blastomeres will grow at the same rate.', 'The blastomere with the gray crescent will stop dividing and die before the second cleavage.']\",\"question\":\"In an experiment, the first cleavage plane of an amphibian zygote was manipulated so that the gray crescent was contained in only one of the two blastomeres that result from the first cleavage. The two blastomeres were then separated. What is the expected fate of the blastomeres?\",\"src\":\"ori_mmlu-college_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}