{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ac10a8e8-0924-59ea-a522-3c43f06dccd1","task_key":"all--test--ac10a8e8-0924-59ea-a522-3c43f06dccd1","task_revision_id":"1","upstream_id":"","short_description":"What is the \"intergenerational storm\" of climate change?","config":"all","split":"test","body":"{\"choices\":\"['the problem of massive world overpopulation over generations.', 'the problem that the bad effects of current carbon dioxide emissions will fall largely on future generations.', 'the problem that the compounding effects of greenhouse gas emissions require the current generation to, in effect, cooperate with future generations.', 'the problem that countries are possibly biased toward the interests of the current generation, which largely benefits from carbon dioxide emissions.']\",\"question\":\" What is the \\\"intergenerational storm\\\" of climate change?\",\"subject\":\"moral_disputes\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}