{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"84505d9f-f392-5333-b94c-9a2160ac96f1","task_key":"default--test--3412","task_revision_id":"1","upstream_id":"3412","short_description":"Mostmarine vertebrates have body fluids with osmotic marine vertebrates have…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Marine organisms osmoregulate by secreting excess water through their gills.', 'Marine organisms osmoregulate by periodically releasing salt crystals through their digestive tract.', 'Marine organisms osmoregulate by reducing their body fluid concentration', 'Marine organisms osmoregulate by avoiding sea water', 'Marine organisms osmoregulate by retaining urea in their bloodstream to balance the osmotic pressure.', 'Marine organisms osmoregulate by undergoing periodic dehydration and rehydration cycles.', 'Marine organisms osmoregulate by producing large amounts of mucus to trap salt particles.', \\\"Marine organisms osmoregulate by absorbing salt through their skin to match the sea water's salinity.\\\", 'Marine organisms osmoregulate by consuming more sea water', 'Marine organisms osmoregulate by actively transporting out excess salt from their body fluids, often through specialized glands.']\",\"question\":\"Mostmarine vertebrates have body fluids with osmotic marine vertebrates have body fluids with osmotic pressure lower than that of their saline environment. How do these organismsosmoregulatein face of aprepetualthreat of dehydration?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}