{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"143adb63-359a-5d9f-a674-a8c8af748735","task_key":"default--test--2940","task_revision_id":"1","upstream_id":"2940","short_description":"Many marine birds drink seawater yet maintain their internal osmolarity at a…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Marine birds excrete salts and nitrogenous wastes through specialized nasal glands.', 'Marine birds absorb water from the environment through their feathers and produce large volumes of dilute urine in the kidneys.', 'Marine birds excrete salts through specialized salt-exchange glands and excrete small volumes of urine.', 'Marine birds excrete salts through their feathers and excrete large volumes of concentrated urine.', 'Marine birds absorb water and salts from the environment through their skin and produce large volumes of dilute urine in the kidneys.', 'Marine birds excrete salts and nitrogenous wastes through their skin.', 'Marine birds excrete salts through specialized salt-exchange glands and produce large volumes of concentrated urine in the kidneys.', 'Marine birds absorb salts from the environment through specialized salt-exchange glands and produce large volumes of concentrated urine in the kidneys.', 'Marine birds absorb salts from the environment through their feathers and produce small volumes of concentrated urine in the kidneys.', 'Marine birds absorb water from the environment through specialized salt-exchange glands and produce large volumes of dilute urine in the kidneys.']\",\"question\":\"Many marine birds drink seawater yet maintain their internal osmolarity at a constant level that is hypoosmotic to seawater. Which of the following physiological strategies best explains how the birds maintain their tissue osmolarity?\",\"src\":\"ori_mmlu-college_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}