{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"de656856-987f-5fcc-b127-97da67b13fc5","task_key":"all--test--de656856-987f-5fcc-b127-97da67b13fc5","task_revision_id":"1","upstream_id":"","short_description":"How do scientists know that the majority of meteorites come from the asteroid…","config":"all","split":"test","body":"{\"choices\":\"['The spectra of some meteorites are similar to the spectra of asteroids in the asteroid belt.', 'The asteroid belt is the only possible source of meteorites therefore they must originate there.', 'Collisions are common in the asteroid belt and we can track the fragments from their source asteroid to the Earth where they become meteorites.', 'High levels of Iridum have been detected in both asteroids and meteorites therefore meteorites come from the asteroid belt.']\",\"question\":\"How do scientists know that the majority of meteorites come from the asteroid belt?\",\"subject\":\"astronomy\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}