{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2bdc4c1b-928e-51ac-a267-6d5d640c2ff2","task_key":"default--test--10452","task_revision_id":"1","upstream_id":"10452","short_description":"For polynomial regression, which one of these structural assumptions is the one…","config":"default","split":"test","body":"{\"category\":\"computer science\",\"options\":\"['The choice of the loss function used in the learning algorithm', 'The assumed variance of the Gaussian noise', 'The number of input variables', 'The use of regularization techniques', 'The type of polynomial function used', 'The use of a constant-term unit input', 'The computational complexity of the algorithm', 'The polynomial degree', 'The scale of the input data', 'Whether we learn the weights by matrix inversion or gradient descent']\",\"question\":\"For polynomial regression, which one of these structural assumptions is the one that most affects the trade-off between underfitting and overfitting:\",\"src\":\"ori_mmlu-machine_learning\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}