{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0bfebc34-535a-596d-91c5-23b6c9f24fc0","task_key":"default--test--2793","task_revision_id":"1","upstream_id":"2793","short_description":"What is the distinction between an aptitude test and an achievement test ?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Aptitude tests measure intelligence, and achievement tests assess practical skills.', 'Aptitude tests evaluate what a person has learned, while achievement tests predict future performance', 'Aptitude tests are only for college admissions, while achievement tests are for high school students', 'Aptitude tests measure the effects of learning under uncontrolled or unknown conditions and serve to predict subsequent performance, while achievement tests evaluate what the individual has gained through training, usually after a uniform prior experience.', \\\"Aptitude tests assess a person's potential in various fields, while achievement tests are standardized tests that compare an individual's performance to a norm.\\\", 'Aptitude tests are informal assessments without standardized scoring, while achievement tests have formal scoring systems.', 'Aptitude tests are used for job recruitment, whereas achievement tests are used exclusively in educational settings.', 'Aptitude and achievement tests serve the same purpose', 'Achievement tests are timed to assess speed, while aptitude tests are not timed and focus solely on accuracy.']\",\"question\":\"What is the distinction between an aptitude test and an achievement test ?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}