{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dd4abe1a-db07-5561-8754-1c6c96dac3fe","task_key":"all--test--dd4abe1a-db07-5561-8754-1c6c96dac3fe","task_revision_id":"1","upstream_id":"","short_description":"Which of the following changes would be characteristic of the “classic aging…","config":"all","split":"test","body":"{\"choices\":\"['Verbal functions are preserved relatively well, bur performance decreases on tests of perceptual-integrative ability', 'The ability to quickly organize and integrate perceptual stimuli declines, while flexibility of thought improves', 'Memory retrieval mechanisms remain relatively intact, except for recall of remote memories', 'Tasks requiring short-term or primary memory show 2 consistent decline']\",\"question\":\"Which of the following changes would be characteristic of the “classic aging pattern” as it applies to performance on psychometric tests of intelligence\",\"subject\":\"professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}