{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"31775bb9-f45b-5df7-9da2-f61b736f6297","task_key":"default--test--3524","task_revision_id":"1","upstream_id":"3524","short_description":"Black-headed gulls remove broken eggshells from their nests immediately after…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"[\\\"Removing eggshells helps regulate the temperature within the nest for the chicks' comfort.\\\", 'The gulls remove eggshells to keep their nests clean.', 'Eggshell-removing behavior reduces the chances of a nest being robbed, thus enhancing the survival of offspring.', 'Removing eggshells is a way to create space for the hatched chicks.', \\\"The eggshells are removed as a source of calcium for the gulls' diet.\\\", 'Removing eggshells prevents the eggs from being eaten by predators.', 'The behavior is a social signal to other gulls that hatching has successfully occurred.', 'Removing eggshells is a way for the gulls to prepare the nest for future clutches of eggs.', 'The gulls remove eggshells to reduce the scent that may attract predators.']\",\"question\":\"Black-headed gulls remove broken eggshells from their nests immediately after the young have hatched. Explain the biological significance of this behavior.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}