{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c7a28ded-5ce1-5770-91e1-e3668c970422","task_key":"default--test--6464","task_revision_id":"1","upstream_id":"6464","short_description":"If a blood unit has been out of refrigeration for longer than the accepted time…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Use it for non-human transfusion purposes.', 'Leave it to reach room temperature before administering.', 'refrigerate for a minimum of 12 hours and then administer it.', 'return it to the blood bank and inform them of why you have done so.', 'dispose of the contents in the sluice area, keeping the bag for record purposes.', 'Use it immediately for the most critical patient.', 'Discard it without notifying the blood bank.', 'Freeze it to preserve it for later use.', 'Return it to the refrigerator and use it within the next 24 hours.', \\\"transfuse it as soon as possible and annotate the patient's notes with the time of administration.\\\"]\",\"question\":\"If a blood unit has been out of refrigeration for longer than the accepted time limit, you should:\",\"src\":\"ori_mmlu-clinical_knowledge\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}