{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"092d6b33-d3c7-5cf6-870b-9384f28d154f","task_key":"default--test--719","task_revision_id":"1","upstream_id":"719","short_description":"Dr. Frankel bought a new X-ray machine for $4,000. It has an estimated life of 5…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['$1,600, $960, $576, $345.6, $207.36', '$1,600, $1,000, $600, $360, $216', '$1,600, $640, $256, $102.4, $40.96', '$1,600, $960, $576, $64, $0', '$1,200, $720, $432, $259.2, $155.52', '$2,000, $1,200, $720, $432, $256', '$1,400, $840, $504, $302.4, $181.44', '$1,600, $960, $576, $345.6, $0', '$1,800, $1,080, $648, $388.8, $233.28', '$1,500, $900, $540, $324, $194.4']\",\"question\":\"Dr. Frankel bought a new X-ray machine for $4,000. It has an estimated life of 5 years, at the end of which its estimated salvage value is $800. Dr. Frankel wishes to use the declining-balance method to compute the machine's depreciation. He will use 40% for his rate of depreciation. Compute the depreciation for each year.\",\"src\":\"stemez-Business\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}