{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"668b1db0-9734-5ead-9118-97008429f5d4","task_key":"default--test--7607","task_revision_id":"1","upstream_id":"7607","short_description":"Neoclassical economists explained interest rates by the concept of time…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Interest is the penalty for early consumption', 'Interest is the reward for immediate consumption', 'Interest is a fee charged by banks independent of market forces', 'Interest rates fluctuate based on the phases of the moon', 'Interest is a tax on savings that discourages postponing consumption', 'Interest rates are irrelevant to time preferences', \\\"Interest rates are determined solely by the government's monetary policy\\\", 'Interest is the cost of borrowing livestock, unrelated to time preferences', 'Interest is the charge for the convenience of accessing funds in the future', 'Interest is the reward to people for postponing consumption']\",\"question\":\"Neoclassical economists explained interest rates by the concept of time preference. How?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}