{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"58ea1a90-c3f2-52d2-b00e-372deb1d3c42","task_key":"all--test--58ea1a90-c3f2-52d2-b00e-372deb1d3c42","task_revision_id":"1","upstream_id":"","short_description":"What is the difference between an absolute date and a relative date?","config":"all","split":"test","body":"{\"choices\":\"['An absolute date is known by everyone, while a relative date ranges from 30 to 50 years.', 'A relative date is derived from radiometric dating techniques, while an absolute date is only associated with written documents.', 'A relative date refers to a year or a range of years, while an absolute date indicates a chronological order.', 'An absolute date refers to a year or a range of years, while a relative date indicates a chronological order.']\",\"question\":\"What is the difference between an absolute date and a relative date?\",\"subject\":\"prehistory\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}