{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b14fd6a5-1fbe-5d78-b066-ecb6a450257b","task_key":"default--test--3044","task_revision_id":"1","upstream_id":"3044","short_description":"Black-headed gulls remove broken eggshells from their nests immediately after…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['It attracts predators away from the nestlings.', 'It aids in temperature regulation of the nest by reducing insulation.', 'It assists in the hatching of other eggs.', 'It is a ritualistic behavior without any particular significance.', 'It signals to other gulls that the nesting site is occupied.', 'It helps to keep the nest clean.', 'It provides extra nutrition to the parents, who eat the eggshells.', 'It is a way of preparing the nest for potential future clutches of eggs.', 'It reduces the chances of a nest being robbed, thus enhancing the survival of offspring.']\",\"question\":\"Black-headed gulls remove broken eggshells from their nests immediately after the young have hatched. Explain the biological significance of this behavior.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}