{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bb257c7b-7df4-5a28-83fa-6b714775b9ef","task_key":"default--test--665","task_revision_id":"1","upstream_id":"665","short_description":"A drama guild is renovating an old theater, hoping to use it for 15 years. The…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['Plan A, with the $5,000 invested first to grow at 6% interest before renovating', 'Plan B, with renovations every 7 years and borrowing at a lower interest rate', 'Plan A', 'Plan B, with the guild members contributing an additional $1,000 upfront for future renovations', 'Plan A, but with an additional loan taken out in the 10th year', 'Plan A, with a smaller renovation every 5 years using money from fundraising events', 'Plan B', 'Both plans', 'Plan B, with additional renovations every 3 years financed by ticket sales', 'Neither plans']\",\"question\":\"A drama guild is renovating an old theater, hoping to use it for 15 years. The guild can follow one of two plans to finance the work: Plan A is to use $5,000 collected from guild members to pay for a renovation job which would be done immediately and would last 15 years. Plan B is to borrow $2,000 the year before the theater opens, and then in the 5th and 10th years of the theater's life to renovate it; each job will last five years. Interest is 6% for both plans. (a) Which plan should the guild follow? (b) If, in Plan B, the 2nd and 3rd renovation jobs will cost $3,000 each and the guild will not be able to borrow the money for any of the three jobs (i.e., the members will have to contribute), which plan should the guild follow?\",\"src\":\"stemez-Business\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}