{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d045ca1d-02f3-5e5b-bad4-1a0a72211926","task_key":"default--test--2484","task_revision_id":"1","upstream_id":"2484","short_description":"What role does factor analysis play in the description of intelligence ?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Factor analysis is used solely for educational placement decisions.', 'Factor analysis categorizes intelligence into fixed levels of ability.', 'Factor analysis is irrelevant in the study of intelligence.', 'Factor analysis is used to determine the genetic basis of intelligence.', 'Factor analysis is used to measure IQ directly.', 'Factor analysis is a tool for creating intelligence enhancement programs.', 'Factor analysis is used to identify underlying intellectual traits and establish descriptive categories in intelligence.', 'Factor analysis is used to establish the exact number of intelligence types.', 'Factor analysis is applied to predict academic performance from intelligence scores.', 'Factor analysis is employed to assess the influence of environment on intelligence development.']\",\"question\":\"What role does factor analysis play in the description of intelligence ?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}