Dynamical Isometry and a Mean Field Theory of CNNs: How to Train 10, 000-Layer Vanilla Convolutional Neural Networks. – PaperGrep

https://papergrep.dev/paper/dynamical-isometry-and-a-mean-field-theory-of-078897