{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"36c78b08-129f-5971-8944-ac6b34915603","task_key":"default--test--3417","task_revision_id":"1","upstream_id":"3417","short_description":"What are some of the cues used by animal in migrating?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Taste, wind direction, humidity', 'Atmospheric oxygen levels, plant growth, tidal patterns', 'Infrared radiation, sound frequency, barometric pressure', 'Moon phases, echo location, gravitational pull', 'Sunlight intensity, water current, soil composition', 'Color perception, thermal stimuli, air pressure', 'Polarization of light, thermal gradients, atmospheric nitrogen levels', \\\"Scent, celestial clues, earth's magnetic field\\\", 'Ultraviolet light, seismic vibrations, electric fields', 'Visual landmarks, sound waves, temperature']\",\"question\":\"What are some of the cues used by animal in migrating?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}