{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"36d9ff14-0b08-50f4-a012-d67ad7b7df27","task_key":"default--test--3413","task_revision_id":"1","upstream_id":"3413","short_description":"Describe the function of the lateral-line system in fishes.","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The lateral-line system in fishes helps with the digestion of food.', 'The lateral-line system in fishes is used for excreting waste materials.', 'The lateral-line system in fishes is involved in the secretion of hormones.', 'The lateral-line system in fishes is used for breathing.', 'The lateral-line system in fishes is used for vision.', 'The lateral-line system in fishes functions to absorb oxygen directly from the water.', 'The lateral-line system in fishes functions in the detection of sound and acceleration, enables the fish to detect localized as well as distant water disturbances, and functions as an organ of equilibrium.', 'The lateral-line system in fishes is primarily for attracting mates during the breeding season.', 'The lateral-line system in fishes is used for reproduction.', 'The lateral-line system in fishes is used for thermoregulation.']\",\"question\":\"Describe the function of the lateral-line system in fishes.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}