{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"56ab2085-8050-53fe-8ef2-d4eee8368ecd","task_key":"default--test--7392","task_revision_id":"1","upstream_id":"7392","short_description":"Whether imposed for protective purposes or to raise revenue, tariffs can be…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Per unit and per category', 'Ad valorem and specific', 'Percentage and fixed fee', 'Comprehensive and selective', 'Fixed rate and variable rate', 'Direct and indirect', 'Proportional and disproportional', 'Import and export', 'Progressive and regressive', 'Flat and graduated']\",\"question\":\"Whether imposed for protective purposes or to raise revenue, tariffs can be imposed in two different ways. Define these two methods of imposing tariffs, and give an example of each.\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}