{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"977bf553-f6b5-572b-b23a-f63731de68cd","task_key":"default--test--5371","task_revision_id":"1","upstream_id":"5371","short_description":"In the debate about the 'managerial revolution', John Scott (1997) argued that:","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['managers were becoming dissatisfied with their working conditions and planned to overthrow the owners of businesses', 'owners still exercised control through groups of shareholders and interlocking directorships', 'ownership and management were becoming increasingly separate functions', 'the managerial revolution was a myth, as owners still held the majority of power in businesses', 'managers were planning to unionize to negotiate better working conditions', 'the principles of scientific management were universally applicable', 'management was becoming increasingly dependent on shareholders', 'the techniques of scientific management were overly bureaucratic and inefficient', 'owners and managers were merging into a single role within businesses', 'owners were losing control over their businesses due to increasing management autonomy']\",\"question\":\"In the debate about the 'managerial revolution', John Scott (1997) argued that:\",\"src\":\"ori_mmlu-sociology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}