{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b326a864-883d-5c92-a05f-45d10dc2a0be","task_key":"default--test--3476","task_revision_id":"1","upstream_id":"3476","short_description":"What prevents the stomach from being digested by itsown secretions?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The stomach has a high permeability to hydrogen ions', 'The presence of beneficial bacteria that neutralize stomach acid', 'The stomach lining is replaced every month', 'The stomach lining secretes digestive enzymes only when food is present', 'The production of bile in the stomach neutralizes the digestive acids', 'A thick layer of muscle tissue that is resistant to digestive enzymes and acids', 'The stomach is protected by a layer of fat', 'The mucus layer, the permeability of the membranes and the continual replacement of the cells comprising the lining all help protect the stomach from being digested by its own secretions.', 'The stomach secretes a special hormone that prevents digestion of its own tissues', 'The stomach contents are too acidic for the enzymes to function properly']\",\"question\":\"What prevents the stomach from being digested by itsown secretions?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}