{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"430aee45-32b2-508d-bda4-71ce19b990b1","task_key":"default--test--7374","task_revision_id":"1","upstream_id":"7374","short_description":"Which of the following statements are true concerning the acf and pacf?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['(i) and (ii) only', '(i) and (iii) only', '(iii) and (iv) only', '(ii), (iii), and (iv) only', '(ii) and (iii) only', '(i), (ii), (iii), and (iv)', '(i), (iii), and (iv) only', '(i) and (iv) only', '(ii) and (iv) only', '(i), (ii), and (iii) only']\",\"question\":\"Which of the following statements are true concerning the acf and pacf?\\n\\n(i) The acf and pacf are often hard to interpret in practice\\n\\n(ii) The acf and pacf can be difficult to calculate for some data sets\\n\\n(iii) Information criteria represent an alternative approach to model order determination\\n\\n(iv) If applied correctly, the acf and pacf will always deliver unique model selections\",\"src\":\"ori_mmlu-econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}