{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ed50e285-baf3-5e41-8fa0-614952eafe9e","task_key":"default--test--7208","task_revision_id":"1","upstream_id":"7208","short_description":"The three basic reasons for holding money are for a) trans-actions purposes, b)…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['i) Transactions purposes, ii) Transactions purposes, iii) Precautionary reasons', 'i) Precautionary reasons, ii) Precautionary reasons, iii) Transactions purposes', 'i) Speculative purposes, ii) Transactions purposes, iii) Precactionary reasons', 'i) Transactions purposes, ii) Speculative purposes, iii) Precautionary reasons', 'i) Transactions purposes, ii) Precautionary reasons, iii) Speculative purposes', 'i) Speculative purposes, ii) Precautionary reasons, iii) Transactions purposes', 'i) Speculative purposes, ii) Speculative purposes, iii) Precautionary reasons', 'i) Precautionary reasons, ii) Speculative purposes, iii) Transactions purposes', 'i) Precautionary reasons, ii) Transactions purposes, iii) Speculative purposes', 'i) Precautionary reasons, ii) Transactions purposes, iii) Precautionary reasons']\",\"question\":\"The three basic reasons for holding money are for a) trans-actions purposes, b) precautionary purposes and c) possible profit or speculation purposes. Given these three motives, indicate which might be most important for the following people; i ) a student on a small allowance from his parents ii) a financially conservative professor with young children to support iii) a \\\"wheeler-dealer\\\"\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}