{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"55907623-6d96-55b7-b78e-1a771a7f68f0","task_key":"all--test--55907623-6d96-55b7-b78e-1a771a7f68f0","task_revision_id":"1","upstream_id":"","short_description":"What made it possible to recover the nearly intact finely-made wooden spears…","config":"all","split":"test","body":"{\"choices\":\"['The soil was highly acidic and aerobic, which offers excellent preservation for organic artifacts.', 'The soil was waterlogged and provided conditions that allowed for the preservation of organic material.', 'The wooden spears were placed in a cache of artifacts in plain sight, where archaeologists would eventually find them.', 'The wooden spears were covered with dried blood mixed with charcoal and mud, which allows for the preservation of wood.']\",\"question\":\"What made it possible to recover the nearly intact finely-made wooden spears from a 300,000-year-old site at Schöningen, Germany?\",\"subject\":\"prehistory\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}