{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"463e418a-3e73-5a76-99a6-b378967a5406","task_key":"default--test--124","task_revision_id":"3","upstream_id":"124","short_description":"_______ economy is the term used to describe individuals being hired for a…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['Gig, Flexibility, Risk, Social welfare structures', 'Gig, Autonomy, Flexibility, Social welfare structures', 'Contract, Risk, Flexibility, Autonomy', 'Sharing, Flexibility, Risk, Social welfare structures', 'Freelance, Risk, Autonomy, Social welfare structures', 'Sharing, Flexibility, Stability, Social welfare structures', 'Traditional, Flexibility, Risk, Social welfare structures', 'Gig, Stability, Risk, Social welfare structures', 'Sharing, Risk, Flexibility, Autonomy', 'Gig, Risk, Flexibility, Autonomy']\",\"question\":\"_______ economy is the term used to describe individuals being hired for a specific task rather than on a long-term basis. While this results in _________ which is beneficial for businesses, issues for those employed in such a manner relate to increased ________, uncertainty and a lack of _______.\",\"src\":\"ori_mmlu-business_ethics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}