{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"31354b58-9763-5dcf-8435-8b223262eea6","task_key":"default--test--85","task_revision_id":"3","upstream_id":"85","short_description":"How does lateral communication in an organisation occur?","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['Information is shared only during official meetings.', 'Information is restricted within a single department.', 'Information is transferred through external stakeholders.', 'Information is transferred only through the head of the organisation.', 'Information is disseminated through public announcements.', 'Information passes upwards.', 'Information passes downwards.', 'Information is a two-way process.', 'Information passes diagonally between different levels of hierarchy.', 'Information passes between different departments and functions.']\",\"question\":\"How does lateral communication in an organisation occur?\",\"src\":\"ori_mmlu-management\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}