{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cb1243af-f5ae-52f5-b822-02a57e9a4c64","task_key":"default--test--586","task_revision_id":"1","upstream_id":"586","short_description":"BobGafneyand Susan Medina invested $40,000 and $50,000 respectively in a…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"[\\\"Mr. Gafney's income is $12,600 and Ms. Medina's income is $16,000\\\", \\\"Mr. Gafney's income is $14,000 and Ms. Medina's income is $14,600\\\", \\\"Mr.Gafney's income is $14,572 and Ms. Medina's income is $15,028\\\", \\\"Mr.Gafney's income is $15,572 and Ms. Medina's income is $13,028\\\", \\\"Mr. Gafney's income is $16,000 and Ms. Medina's income is $12,600\\\", \\\"Mr.Gafney's income is $14,572 and Ms. Medina's income is $14,028\\\", \\\"Mr. Gafney's income is $15,300 and Ms. Medina's income is $13,300\\\", \\\"Mr. Gafney's income is $13,300 and Ms. Medina's income is $15,300\\\", \\\"Mr. Gafney's income is $14,600 and Ms. Medina's income is $14,000\\\", \\\"Mr.Gafney's income is $13,572 and Ms. Medina's income is $15,028\\\"]\",\"question\":\"BobGafneyand Susan Medina invested $40,000 and $50,000 respectively in a luncheonette. Since Mr.Gafneyis the manager of the luncheonette, he gets 4% of the net income. Each partner receives 6% interest on his or her investment. Any remaining net income is divided equally. If the net income for any year is $28,600, how is it divided?\",\"src\":\"stemez-Business\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}