{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f228d062-e9ca-5945-8ac8-2faaee1ea2c4","task_key":"default--test--6284","task_revision_id":"1","upstream_id":"6284","short_description":"What is the risk if water is used for bladder washout in secondary care?","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['The medical staff may be unhappy.', 'The patient may experience discomfort.', 'Fluid may bypass when the washout is carried out.', 'Using water may cause a urinary tract infection.', 'There is no risk in using water for bladder washout.', 'It may lead to kidney damage.', 'The procedure may need to be repeated.', 'Using water may cause electrolyte imbalance.', 'Bladder washout may be unsuccessful.']\",\"question\":\"What is the risk if water is used for bladder washout in secondary care?\",\"src\":\"ori_mmlu-clinical_knowledge\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}