{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c223dd8b-272e-51b3-9389-eef98c4e0c41","task_key":"default--test--11082","task_revision_id":"1","upstream_id":"11082","short_description":"What is the \"intergenerational storm\" of climate change?","config":"default","split":"test","body":"{\"category\":\"philosophy\",\"options\":\"['the problem of massive world overpopulation over generations.', 'the problem that the pace of climate change is too fast for future generations to adapt.', 'the problem of greenhouse gas emissions increasing over generations due to technological advancements.', 'the problem that current generations are not doing enough to prevent climate change, thus leaving future generations to deal with the consequences.', 'the problem that the compounding effects of greenhouse gas emissions require the current generation to, in effect, cooperate with future generations.', 'the problem of a lack of education among current generations about the long-term effects of climate change.', 'the problem that future generations may not be able to afford the costs of reversing the effects of climate change.', 'the problem that the negative effects of climate change disproportionately affect the younger generation.', 'the problem that the bad effects of current carbon dioxide emissions will fall largely on future generations.', 'the problem that countries are possibly biased toward the interests of the current generation, which largely benefits from carbon dioxide emissions.']\",\"question\":\" What is the \\\"intergenerational storm\\\" of climate change?\",\"src\":\"ori_mmlu-moral_disputes\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}