{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bdad7b0e-b7b6-59e1-afd7-fa5ef4a1c5d2","task_key":"default--test--11525","task_revision_id":"1","upstream_id":"11525","short_description":"Using the definition of the bilateral z transform F (z) = ^\\infty\\sum_n=-\\infty…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['3z^-2 + 4z^-1 + 2z^3', '3z^2+ 4z^-1 + 2z^-3', '2z^3 + 4z^-2 + 3z^-1', '4z^2+ 3z^-1 + 2z^-3', '4z^-3 + 3z^-2 + 2z^-1', '3z^2+ 2z^-1 + 4z^-3', '2z^2+ 4z^-1 + 3z^-3', '3z^3 + 4z + 2z^-2', '4z^3 + 2z + 3z^-2', '2z^-1 + 3z^-3 + 4z^2']\",\"question\":\"Using the definition of the bilateral z transform F (z) = ^\\\\infty\\\\sum_n=-\\\\infty f[n] z^-n, find the z - transform of f[n] = 3\\\\delta [n+2] + 4\\\\delta [n-1] + 2\\\\delta [n-3].\",\"src\":\"stemez-ElectricCircuits\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}