{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fb715252-40fc-5e69-8f3a-d87cadaa5bb3","task_key":"default--test--5717","task_revision_id":"1","upstream_id":"5717","short_description":"Goll Co. has a 25% interest in the common stock of Rose Co. and an 18% interest…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['Jave only.', 'Neither Rose nor Jave, unless Goll acquires significant influence.', 'Both Rose and Jave, if Goll acquires additional shares.', 'Rose only.', 'Neither Rose nor Jave.', 'Both Rose and Jave, if Goll has significant influence over their operating policies.', 'Both Rose and Jave.', 'Jave only, if Goll can influence its operating policies.', 'Rose only, if Goll can influence its financial policies.', 'Rose only, if Goll acquires significant influence.']\",\"question\":\"Goll Co. has a 25% interest in the common stock of Rose Co. and an 18% interest in the common stock of Jave Co. Neither investment gives Goll the ability to exercise significant influence over either company's operating and financial policies. Which of the two investments should Goll account for using the equity method?\",\"src\":\"ori_mmlu-professional_accounting\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}