{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2544b3f6-c964-5c5a-8cb5-6468238be76e","task_key":"default--test--805","task_revision_id":"1","upstream_id":"805","short_description":"A resort computes its guest fees on the basis of the duration of the visit (D) ,…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['x = $100, y = $15', 'x = $75, y = $20', 'x = $90, y = $35', 'x = $70, y = $15', 'x = $125, y = $5', 'x = $50, y = $25', 'x = $85, y = $10', 'x = $60, y = $30', 'x = $40, y = $45', 'x = $20, y = $75']\",\"question\":\"A resort computes its guest fees on the basis of the duration of the visit (D) , plus the amount of time spent in the steam-massage room. Tom spends 4 days at the resort and 10 hours in the steam-massage room. In a 7 day stay, Jane spends 30 hours with masseurs. Their bills are $500. and $1,125, respectively. The cost of a visit (C) is given by the following linear equation: C =xD+yH. Find the values of the constants x and y.\",\"src\":\"stemez-Business\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}