{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"94445d7c-fbc2-553d-af01-6ab444c283ba","task_key":"default--test--95","task_revision_id":"3","upstream_id":"95","short_description":"Where in the balance sheet does each of the following belong? (A) Taxes payable…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"[\\\"(A) Liability section, (B) Asset side, (C) Owner's Equity section, (D) Asset side, (E) Owner's Equity section\\\", \\\"(A) Owner's Equity section, (B) Asset side, (C) Income Statement, (D) Liability section, (E) Liability section\\\", \\\"(A) Asset side, (B) Liability section, (C) Income Statement, (D) Owner's Equity section, (E) Income Statement\\\", \\\"(A) Owner's Equity section, (B) Liability section, (C) Asset side, (D) Asset side, (E) Income Statement\\\", \\\"(A) Income Statement, (B) Liability section, (C) Asset side, (D) Owner's Equity section, (E) Owner's Equity section\\\", \\\"(A) Owner's Equity section, (B) Income Statement, (C) Asset side, (D) Asset side, (E) Liability section\\\", '(A) Liability section, (B) Asset side, (C) Liability section, (D) Income Statement, (E) Income Statement', \\\"(A) Income Statement, (B) Owner's Equity section, (C) Income Statement, (D) Liability section, (E) Asset side\\\", \\\"(A) Asset side, (B) Income Statement, (C) Liability section, (D) Owner's Equity section, (E) Liability section\\\", \\\"(A) Liability section, (B) Owner's Equity section, (C) Owner's Equity section, (D) Income Statement, (E) Asset side\\\"]\",\"question\":\"Where in the balance sheet does each of the following belong? (A) Taxes payable (B) Capital stock (C) Retailed earnings (D) Administrative expense (E) Prepaid expenses\",\"src\":\"stemez-Business\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}