{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d82362e9-da2e-5b07-9e89-0d8046b74cbb","task_key":"all--test--d82362e9-da2e-5b07-9e89-0d8046b74cbb","task_revision_id":"1","upstream_id":"","short_description":"Which of the following statements reflects the Confucian worldview that figured…","config":"all","split":"test","body":"{\"choices\":\"['Having faith in God will be rewarded in the afterlife.', \\\"Life's ultimate goal is to escape the suffering inherent in the endless cycle of death and reincarnation.\\\", 'A life of quiet contemplation and isolation from worldly temptations will result in self-perfection.', 'Observing rules of proper behavior toward others will ensure social and political harmony.']\",\"question\":\"Which of the following statements reflects the Confucian worldview that figured prominently in classical Chinese culture?\",\"subject\":\"miscellaneous\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}