{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6f8f24be-1ade-5ef5-83ae-7d03aaf0f262","task_key":"default--test--855","task_revision_id":"1","upstream_id":"855","short_description":"Suppose that your utility bill for July states that you used 328 kw-hrs of…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['Electric bill: $9.45, Gas bill: $7.68, Phone bill: $13.50', 'Electric bill: $8.79, Gas bill: $6.02, Phone bill: $10.94', 'Electric bill: $10.25, Gas bill: $7.50, Phone bill: $10.00', 'Electric bill: $15.00, Gas bill: $8.10, Phone bill: $14.22', 'Electric bill: $13.20, Gas bill: $4.87, Phone bill: $9.68', 'Electric bill: $5.22, Gas bill: $11.00, Phone bill: $10.38', 'Electric bill: $12.86, Gas bill: $6.27, Phone bill: $5.53', 'Electric bill: $10.38, Gas bill: $5.22, Phone bill: $11.00', 'Electric bill: $11.00, Gas bill: $5.53, Phone bill: $12.86', 'Electric bill: $6.87, Gas bill: $9.35, Phone bill: $11.76']\",\"question\":\"Suppose that your utility bill for July states that you used 328 kw-hrs of electricity and 1400 cu. ft. of natural gas. There is a flat rate of $1.70 for the first 15 kw-hours. Different rates are set for daytime, evening and late-evening to 8 A.M. You used 45 hours at .043 per hour, 140 hours at $.0318 per hour, and 128 hours at .0179 per hour. The charges for gas are: 600 cu. ft. ($3.20 flat charge) plus 800 cu. ft. at $.253 per 100 cu. ft. Your phone bill, subject to a 10% federal tax, has a basic charge of $6.27, plus long distance calls at $1.36 and $3.45. Electric, gas, and phone bills are subject to a 6% city tax. What is the total amount of each bill?\",\"src\":\"stemez-Business\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}