{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"79e4edf5-d978-5831-9737-ae4ab2da833a","task_key":"default--test--7477","task_revision_id":"1","upstream_id":"7477","short_description":"What is the fundamental difference betweenconsumer demandfor goods and services…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Consumers demand is always fluctuating, while employer demand is constant', 'Consumers are focused on the cost of goods and services, while employers are focused on the skills of workers', 'Employers demand workers based on market trends, consumers demand goods and services based on personal needs', 'Both consumers and employers are driven by satisfaction', 'Employer demand for workers is driven by technology advancements, consumer demand for goods and services is driven by advertising', 'Employers buy goods and services for profit, consumers hire workers for satisfaction', 'Both consumers and employers are driven by profit', 'Consumers demand goods and services based on scarcity, employers hire workers based on availability', 'Consumers buy goods and services for satisfaction, employers hire workers for profit', 'Consumers demand goods and services based on quality, employers demand workers based on quantity']\",\"question\":\"What is the fundamental difference betweenconsumer demandfor goods and services and employer demand for workers?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}