{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"205cd161-6552-5eec-b573-bae09847c71a","task_key":"default--test--340","task_revision_id":"1","upstream_id":"340","short_description":"Y is paid $380 semi-monthly. W receives $55 per day, and works four days each…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['Y: $9500 yearly, $182.69 weekly; W: $12600 yearly, $242.31 weekly; U: $5800 yearly, $111.54 weekly; S: $14080 yearly, $270.77 weekly', 'Y: $912 yearly, $17.53 weekly; W: $1144 yearly, $22 weekly; U: $576 yearly, $11.07 weekly; S: $1339 yearly, $25.75 weekly', 'Y: $8400 yearly, $161.54 weekly; W: $10400 yearly, $200 weekly; U: $5280 yearly, $101.54 weekly; S: $12340 yearly, $237.31 weekly', 'Y: $7600 yearly, $146.15 weekly; W: $8800 yearly, $169.23 weekly; U: $9600 yearly, $184.61 weekly; S: $10300 yearly, $198.07 weekly', 'Y: $760 yearly, $14.61 weekly; W: $2860 yearly, $55 weekly; U: $960 yearly, $18.46 weekly; S: $2060 yearly, $39.61 weekly', 'Y: $9120 yearly, $175.38 weekly; W: $11440 yearly, $220 weekly; U: $5760 yearly, $110.77 weekly; S: $13390 yearly, $257.50 weekly', 'Y: $7980 yearly, $153.46 weekly; W: $11020 yearly, $212 weekly; U: $4560 yearly, $87.69 weekly; S: $12075 yearly, $232.21 weekly', 'Y: $91200 yearly, $1753.80 weekly; W: $114400 yearly, $2200 weekly; U: $57600 yearly, $1107.70 weekly; S: $133900 yearly, $2575.00 weekly', 'Y: $3800 yearly, $170.38 weekly; W: $5500 yearly, $200 weekly; U: $4800 yearly, $100.77 weekly; S: $5150 yearly, $257.00 weekly', 'Y: $9840 yearly, $189.23 weekly; W: $14300 yearly, $275 weekly; U: $6240 yearly, $120 weekly; S: $15470 yearly, $297.50 weekly']\",\"question\":\"Y is paid $380 semi-monthly. W receives $55 per day, and works four days each week. U is paid $480.00 per month S makes a bi-weekly salary of $515. All are paid for a 52-week year a) What is the yearly salary of each? b) How much does each student make, per week?\",\"src\":\"stemez-Business\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}