{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f7684c58-07b4-5cd7-a7d7-3fcaf3755bb8","task_key":"default--test--6529","task_revision_id":"1","upstream_id":"6529","short_description":"Which of the following is true about the assessment of arm reflexes?","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['The biceps reflex is not related to any root value', 'Striking the Achilles tendon is used to assess arm reflexes', 'Brachioradialis reflex is assessed by tapping the bicep tendon', 'An absent reflex when tapping a tendon is a normal finding', 'The triceps tendon is struck in the antecubital fossa', 'The root value of the biceps reflex is C5, C6', 'Brisk finger jerks confirm a lower motor neurone lesion', 'Absence of reflex when tapping a tendon indicates a higher motor neurone lesion', 'The root value of the triceps reflex is C5, C6']\",\"question\":\"Which of the following is true about the assessment of arm reflexes?\",\"src\":\"ori_mmlu-clinical_knowledge\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}