{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"470a1d2f-1349-5580-b1cc-2824de7d6898","task_key":"default--test--6725","task_revision_id":"1","upstream_id":"6725","short_description":"Which of these is not necessary when examining the jugular venous pulse?","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Checking the pulse on both sides of the neck', 'Using a magnifying glass', 'Using a stethoscope', 'Patient should be in a standing position', 'Patient holding their breath', 'Good lighting', \\\"Turning the patient's head to the right\\\", 'Timing the pulsation with the radial pulse', \\\"Patient's neck muscles should be relaxed\\\", 'Patient lying at 45 degree angle']\",\"question\":\"Which of these is not necessary when examining the jugular venous pulse?\",\"src\":\"ori_mmlu-clinical_knowledge\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}