{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9cafbd9c-2430-5173-9a3a-131c0ca2c4a6","task_key":"default--test--6988","task_revision_id":"1","upstream_id":"6988","short_description":"Which of the following statements are true concerning the standardised residuals…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['(i), (ii), and (iii) only', '(i), (ii), (iii), and (iv)', '(iii) and (iv) only', '(i) and (iv) only', '(i) and (iii) only', '(i), (iii), and (iv) only', '(ii) and (iv) only', '(i) and (ii) only', '(ii) and (iii) only', '(ii), (iii), and (iv) only']\",\"question\":\"Which of the following statements are true concerning the standardised residuals (residuals divided by their respective conditional standard deviations) from an estimated GARCH model?\\n\\ni) They are assumed to be normally distributed\\n\\n\\nii) Their squares will be related to their lagged squared values if the GARCH model is\\n\\nappropriate\\n\\n\\niii) In practice, they are likely to have fat tails\\n\\n\\niv) If the GARCH model is adequate, the standardised residuals and the raw residuals\\n\\nwill be identical\",\"src\":\"ori_mmlu-econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}