{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"db52b714-dcdb-5cff-a3e0-25da9cea531a","task_key":"default--test--7470","task_revision_id":"1","upstream_id":"7470","short_description":"Explain why the opportunity for unions to increase the demand for labor is…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Unions determine labor productivity', 'Unions can directly control employment rates nationally', 'Unions are the primary drivers of economic growth and thereby increase labor demand', 'Unions can significantly increase labor demand', 'Unions have limited means to influence the demand for labor', 'Unions negotiate labor demand on behalf of all sectors', 'Unions set the prices for labor across all industries', 'Unions control the demand for labor', 'Unions can ensure job security for all workers', 'Unions establish the minimum wage independently of government legislation']\",\"question\":\"Explain why the opportunity for unions to increase the demand for labor is limited.\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}