{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"16522d47-fc18-5586-88d5-753e897bb65e","task_key":"default--test--2375","task_revision_id":"1","upstream_id":"2375","short_description":"What is cross-validation and why is it important?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Cross-validation is only used for validating models in large datasets and is not suitable for small datasets', 'Cross-validation is a method for enhancing the complexity of a model to improve its performance on a single data set', 'Cross-validation is not important in small samples', 'Cross-validation is a method to independently determine the validity of a test on additional samples, it is necessary especially when the initial validation sample is small, to avoid errors and chance factors.', 'Cross-validation involves using different tests to measure the same variable to ensure the tests agree with each other', 'Cross-validation is a process where the performance of a test is only assessed once to ensure speed and efficiency', 'Cross-validation is a method to validate a test without additional samples', 'Cross-validation is a technique to assess the performance of a model by splitting the data into two sets: one for training and one for final testing', 'Cross-validation is the replication of a test using the same dataset to confirm the initial results', 'Cross-validation is a method to determine the validity of a test on the same sample']\",\"question\":\"What is cross-validation and why is it important?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}