{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1846026f-1713-554d-85b7-c920764a14d2","task_key":"default--test--2111","task_revision_id":"1","upstream_id":"2111","short_description":"Briefly trace historical attitudes toward human development emphasizing the…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Both endogenous (biological) and environmental factors are recognized as essential in human development.', 'Development is solely determined by biological factors.', 'Environmental factors shape development until adolescence, after which biology takes over completely.', 'Biological factors set the potential for development, which is then unchangeable by environmental influences.', 'Human development is a random process, not influenced by either biological or environmental factors.', 'Human development is exclusively the result of personal choices, independent of biology or environment.', 'Human development is predetermined at birth, with no influence from life experiences.', 'Human development is entirely influenced by the environment.', 'Development is solely determined by social interactions, with no biological influence.', 'Children are innately evil and need to redeem themselves.']\",\"question\":\"Briefly trace historical attitudes toward human development emphasizing the debate between biological determinism and environmental determinism.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}