{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a7272637-a9cb-5d2a-8b14-6ce54de4b781","task_key":"default--test--7610","task_revision_id":"1","upstream_id":"7610","short_description":"a) If you are holding interest bearing bonds (Z), the interest rate is (i), and…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['10 transactions', '8 transactions', '6 transactions', '30 transactions', '5 transactions', '15 transactions', '12 transactions', '25 transactions', '20 transactions', '18 transactions']\",\"question\":\"a) If you are holding interest bearing bonds (Z), the interest rate is (i), and the cost of transactions is (b), what is the optimal number of transactions to make (n) so as to maximize the amount of interest received from the bonds? b) If you have $10,000 in bonds, the interest rate is 10%, the cost of transactions is $5, what would be the optimal amount of transactions?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}