{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"689a590e-76b7-50ea-b0d2-98bab18e1932","task_key":"default--test--3321","task_revision_id":"1","upstream_id":"3321","short_description":"Black-headed gulls remove broken eggshells from their nests immediately after…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Gulls remove eggshells as a part of their feeding habit', 'Gulls use the removed eggshells as a source of calcium for the young birds', 'Eggshell-removing behavior is significant in that it reduces the chances of a nest being robbed, thus enhancing the survival of offspring.', 'The removal of eggshells is a ritualistic behavior with no direct biological significance', 'Gulls remove eggshells to reuse them for building nests', 'Gulls remove eggshells to prevent injury to the young birds in the nest', 'The removal of eggshells is a territorial display to deter rival gulls from the area', 'Eggshells are removed to make space for more eggs to be laid in the same season', 'Removing eggshells helps regulate the temperature within the nest for the young birds', 'The gulls remove the eggshells to keep their nests clean']\",\"question\":\"Black-headed gulls remove broken eggshells from their nests immediately after the young have hatched. Explain the biological significance of this behavior.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}