{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e4c9b52a-0bf1-57fb-8cbf-4b67a9f51a5b","task_key":"default--test--10730","task_revision_id":"1","upstream_id":"10730","short_description":"Which among the following prevents overfitting when we perform bagging?","config":"default","split":"test","body":"{\"category\":\"computer science\",\"options\":\"['The use of all data without sampling', 'The practice of validation performed on a random subset of classifiers trained', 'The use of underfitting to counterbalance overfitting', 'The use of weak classifiers', 'The use of classification algorithms which are prone to overfitting', 'The use of classification algorithms which are not prone to overfitting', 'The use of sampling with replacement as the sampling technique', 'The practice of validation performed on every classifier trained', 'The use of strong classifiers', 'The use of sampling without replacement as the sampling technique']\",\"question\":\"Which among the following prevents overfitting when we perform bagging?\",\"src\":\"ori_mmlu-machine_learning\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}