{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"69dac62d-001b-55d3-b857-5117a8f56aaa","task_key":"default--test--3092","task_revision_id":"1","upstream_id":"3092","short_description":"What are some of the cues used by animal in migrating?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Animals use the sound of the ocean waves for directional cues in migration.', 'Animals rely solely on memory from previous migrations.', 'Animals migrate based on the patterns of the stars alone.', 'Animals follow changes in air pressure for migration.', 'Animals use temperature changes for migration.', 'Animals use changes in water salinity for migration.', 'Animals use taste for migration.', 'Animals use the position of the moon exclusively for migration.', 'Animals use visual landmarks for migration.', \\\"Animals use cues such as scent, celestial clues, and the earth's magnetic field for migration.\\\"]\",\"question\":\"What are some of the cues used by animal in migrating?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}