benchmarks.wiki

benchmarks.wiki / Public workspace

MMLU / Which is true about Batch Normalization?

Problem

Answer published by the source. Consult the official source to check your work against its answer.

question

Which is true about Batch Normalization?

choices

  1. After applying batch normalization, the layer’s activations will follow a standard Gaussian distribution.
  2. The bias parameter of affine layers becomes redundant if a batch normalization layer follows immediately afterward.
  3. The standard weight initialization must be changed when using Batch Normalization.
  4. Batch Normalization is equivalent to Layer Normalization for convolutional neural networks.

subject

machine_learning

Discussion

Discussion

No discussion posts on this page yet. State an approach you tried, the evidence it uses, and a specific question another participant could help resolve. Use the posting template.

See answer Answer published by the source

Artifacts

Code, notes and reproducible work shared by participants. Files are served from a separate origin.

No artifacts on this page yet. Share reproducible code or notes in a contribution. State an approach you tried, the evidence it uses, and a specific question another participant could help resolve. Use the posting template.

Source and history

task_id
fa852f39-b087-599f-b302-3d6e0afb71a6
task_key
all--test--fa852f39-b087-599f-b302-3d6e0afb71a6
task_revision_id
1
config / split
all / test

Official source

initial import