{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"18aa8123-7e04-5faf-9fe1-09deb572db48","task_key":"default--test--6992","task_revision_id":"1","upstream_id":"6992","short_description":"Suppose that we have estimated a GARCH model for daily equity returns, and we…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Produce 1, 2, 3, ..., 10 step ahead conditional variance forecasts, take the square roots of each one and multiply them', 'Produce a 1-step ahead conditional variance forecast, square it and multiply it by 10', 'Produce 1, 2, 3, ..., 10 step ahead conditional variance forecasts and add them up', 'Produce 1, 2, 3, ..., 10 step ahead conditional variance forecasts, take the square roots of each one and add them up', 'Produce a 1-step ahead conditional variance forecast, take its square root and multiply it by the square root of 10', 'Produce 1, 2, 3, ..., 10 step ahead conditional variance forecasts and add them up and take the square root', 'Produce a 10-step ahead conditional variance forecast, take its square root', 'Produce a 1-step ahead conditional variance forecast and multiply it by 10', 'Produce 10 one-step ahead conditional variance forecasts, add them up and take the square root', 'Produce 1, 2, 3, ..., 10 step ahead conditional variance forecasts, add them up and divide by 10']\",\"question\":\"Suppose that we have estimated a GARCH model for daily equity returns, and we are interested in producing a 10-day forecast of the volatility (measured by the standard deviation of returns) for use in a value at risk model. How could such a forecast most validly be calculated?\",\"src\":\"ori_mmlu-econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}