{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"45fd9801-e382-5602-8014-1d8bd6387e8b","task_key":"default--test--3486","task_revision_id":"1","upstream_id":"3486","short_description":"In a certain species of flies, the male presents the female witha silken balloon…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The silken balloon is a territorial marker to ward off competing males.', 'The presentation of a silken balloon to the female fly before mating is the result of the evolution of a behavior pattern, which evolved as a way to distract the female and prevent the male from being eaten during mating.', \\\"The silken balloon is used to display the male's fitness by demonstrating his ability to gather resources.\\\", \\\"The silken balloon contains pheromones to increase the female's receptivity to mating.\\\", 'The silken balloon is a gift to the female', 'The silken balloon is used by the male fly to trap the female', 'The silken balloon is a way for the male fly to showcase his weaving skills', 'The silken balloon acts as a decoy to confuse predators while the flies mate.', 'The silken balloon serves as a physical barrier to protect the male from predators during mating.', 'The silken balloon is a mechanism for the male to control the timing of mating by releasing the female when she is most fertile.']\",\"question\":\"In a certain species of flies, the male presents the female witha silken balloon before mating. Explain the evolutionary derivationof this behavior.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}