{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1af8b61e-200e-5390-b663-ab74f07deebf","task_key":"default--test--293","task_revision_id":"1","upstream_id":"293","short_description":"The Dickenson Company has purchased a hand-operated machine of the following…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['Neither options', 'Keep the hand-operated machine for 4 years, then switch to the automatic machine for 1 year', 'Purchase the automatic machine immediately without selling the hand-operated machine', 'Option B', 'Keep the hand-operated machine for 3 years, then switch to the automatic machine for 2 years', 'Keep the hand-operated machine for 2 years, then switch to the automatic machine for the remaining 3 years', 'Option A, but negotiate a higher salvage value for the hand-operated machine after 5 years', 'Option B, but seek a lower purchase price for the automatic machine', 'Option A', 'Both options']\",\"question\":\"The Dickenson Company has purchased a hand-operated machine of the following description; after a year, it can purchase an automatic machine of equal capacity and sell the first machine for $1,600. The following data is available: Hand-Operated Machine Automatic Machine Purchase price $4,400 $6,200 Expected Useful life 5 years 4 years Expected salvage value $0 $0 Annual operating costs $2,600 $800 The current interest rate is 8%. Which of the following options should the company chose? Option A - Keep the hand-operated machine 5 years. Option B - Keep the hand-operated machine 1 year, sell it, and purchase the automatic to use for 4 years. Round all calculations to the nearest dollar.\",\"src\":\"stemez-Business\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}