{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"31218628-6199-5818-93de-559a010279d5","task_key":"default--test--10367","task_revision_id":"1","upstream_id":"10367","short_description":"Which is true about Batch Normalization?","config":"default","split":"test","body":"{\"category\":\"computer science\",\"options\":\"['Batch Normalization does not provide any benefits when used with ReLU activation function.', 'Batch Normalization should only be used for fully-connected layers in neural networks.', 'Batch Normalization eliminates the need for dropout in a neural network.', 'The standard weight initialization must be changed when using Batch Normalization.', 'Batch Normalization is equivalent to Layer Normalization for convolutional neural networks.', 'The bias parameter of affine layers becomes redundant if a batch normalization layer follows immediately afterward.', 'Batch Normalization makes the learning rate redundant.', 'Batch Normalization adjusts the weights of the network instead of the activations.']\",\"question\":\"Which is true about Batch Normalization?\",\"src\":\"ori_mmlu-machine_learning\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}