{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d2b6b057-435e-5c42-b5fd-839984ce1c63","task_key":"default--test--7678","task_revision_id":"1","upstream_id":"7678","short_description":"What are leading, coincidental, and lagging indicators of economic activity?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Leading indicators lag behind the business cycle, coincidental indicators precede it, and lagging indicators coincide with it.', \\\"Leading indicators conform to the business cycle and turn downward prior to its peak and upward before its trough. Coincidental indicators coincide with the business cycle's turning points. Lagging indicators turn downward after the business cycle's peak and upward after its trough.\\\", \\\"Leading indicators turn upward during the business cycle's peak and downward during its trough. Coincidental indicators have no consistent pattern with the business cycle. Lagging indicators turn downward before the business cycle's peak and upward before its trough.\\\", 'Leading indicators coincide with the business cycle, coincidental indicators lag behind it, and lagging indicators precede it.', \\\"Leading indicators are unrelated to the business cycle. Coincidental indicators coincide with the business cycle's peak and trough. Lagging indicators turn downward at the business cycle's peak and upward at its trough.\\\", \\\"Leading indicators predict the business cycle and turn upward after its peak and downward before its trough. Coincidental indicators follow the business cycle's turning points. Lagging indicators turn upward before the business cycle's peak and downward after its trough.\\\", \\\"Leading indicators turn downward immediately after the business cycle's peak and upward immediately after its trough. Coincidental indicators fluctuate independently of the business cycle. Lagging indicators turn upward prior to the business cycle's peak and downward prior to its trough.\\\", 'Leading indicators follow the business cycle, coincidental indicators precede it, and lagging indicators coincide with it.', \\\"Leading indicators fluctuate randomly and are not predictive of the business cycle. Coincidental indicators coincide with the business cycle's midpoint. Lagging indicators turn upward long after the business cycle's peak and downward long after its trough.\\\", \\\"Leading indicators turn downward after the business cycle's trough and upward after its peak. Coincidental indicators align with the business cycle's midpoints. Lagging indicators turn upward before the business cycle's trough and downward before its peak.\\\"]\",\"question\":\"What are leading, coincidental, and lagging indicators of economic activity?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}