{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3af52265-e721-5d55-b66d-7011e01311d0","task_key":"default--test--3175","task_revision_id":"1","upstream_id":"3175","short_description":"Describe the evolution of the reptilian excretory system to account for the…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The excretory system includes a secondary bladder for water storage.', 'The reptilian excretory system has evolved to excrete more water', 'Reptiles have evolved to have a smooth, wet skin', 'Reptiles have evolved to excrete nitrogenous wastes primarily as ammonia to conserve water.', 'Reptiles have developed larger glomeruli to increase water retention.', 'The excretory system has adapted to increase salt excretion to facilitate life in marine environments.', 'Reptilian kidneys have evolved to produce ammonia directly for more efficient water use.', 'Reptiles excrete nitrogenous wastes as urea', 'The excretory system has evolved a complex series of ducts to recycle water back into the body.', 'The reptilian excretory system has evolved to conserve most of its water with modifications like a coarse, dry, horny skin, decreased size of glomeruli, greater reabsorption of water from glomerular filtrate, and excretion of nitrogenous wastes as uric acid.']\",\"question\":\"Describe the evolution of the reptilian excretory system to account for the transition from an aquatic to a terrestrial habitat.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}