{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9a651b5e-dc1f-5537-9e1b-09c64bc657d7","task_key":"default--test--2974","task_revision_id":"1","upstream_id":"2974","short_description":"What prevents the stomach from being digested by itsown secretions?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['A thick layer of fat surrounds the stomach, providing protection from digestive acids.', 'Special bacteria in the stomach neutralize all digestive enzymes.', 'The stomach lining secretes an alkaline substance that counteracts the acid and prevents digestion.', 'The lining of the stomach secretes only hydrochloric acid and gastric juice.', 'The mucus layer, the permeability of the membranes and the continual replacement of the cells comprising the lining all help protect the underlying tissues from the action of proteolytic enzymes of the stomach and duodenum.', 'The stomach is coated with a layer of strong antibiotics that kill digestive enzymes.', 'The stomach lining is replaced every 10 to 15 days.', 'The stomach has a high permeability to hydrogen ions.', 'The stomach has a unique pH that prevents enzymes from being active.', 'Digestive enzymes in the stomach are only activated by food, so they do not attack the stomach lining.']\",\"question\":\"What prevents the stomach from being digested by itsown secretions?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}