{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0a499426-9b79-52e5-9c37-9b6bc89bc17c","task_key":"default--test--2055","task_revision_id":"1","upstream_id":"2055","short_description":"Have studies on learning supported the Incremental or the One-trial Theory of…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Incremental Theory is supported in cognitive tasks, while One-trial Theory is supported in motor tasks.', 'The Incremental Theory is universally supported, while the One-trial Theory has been completely discredited.', 'Studies support the One-trial Theory in the short term, but the Incremental Theory in the long term.', 'Studies support a hybrid model that combines elements of both theories.', 'One-trial Theory is supported for simple tasks, while Incremental Theory is for complex tasks.', 'Neither theories of learning are correct.', 'Both theories of learning are correct, depending on the context.', 'The Incremental Theory is only supported in animal studies, while the One-trial Theory is supported in human studies.', 'Only One-trial Theory of learning is supported.', 'Only Incremental Theory of learning is supported.']\",\"question\":\"Have studies on learning supported the Incremental or the One-trial Theory of learning?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}