{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fcc0c1a8-a387-50c6-9c09-c987899d32d4","task_key":"default--test--7657","task_revision_id":"1","upstream_id":"7657","short_description":"If a Johansen \"trace\" test for a null hypothesis of 2 cointegrating vectors is…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['The largest and smallest', 'The smallest and second smallest', 'The middle two', 'The smallest 2', 'The largest 2', 'The third and fourth largest', 'The second largest', 'The second smallest and second largest', 'All of them', 'The largest and second largest']\",\"question\":\"If a Johansen \\\"trace\\\" test for a null hypothesis of 2 cointegrating vectors is applied to a system containing 4 variables is conducted, which eigenvalues would be used in the test?\",\"src\":\"ori_mmlu-econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}