{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"526dc2a5-1742-5752-a5c1-0f31e9826466","task_key":"default--test--3189","task_revision_id":"1","upstream_id":"3189","short_description":"What are some of the cues used by animal in migrating?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Animals use the temperature changes as cues.', 'Animals use the color of the surroundings as cues.', 'Animals use the noises from the environment as cues.', 'Animals navigate by following other migrating animal species exclusively.', 'Animals rely solely on the memory of previous migration paths.', 'Animals use the taste of the local vegetation as a primary cue.', 'Animals depend on the guidance of human-made structures for migration.', 'Animals use the phase of the moon as the sole cue for migration.', 'Animals exclusively use the position of the sun at noon for migration.', \\\"Animals use several cues in their migrations such as scent, celestial cues, and the earth's magnetic field.\\\"]\",\"question\":\"What are some of the cues used by animal in migrating?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}