pondsiders.dev

Sparse Networks and Lottery Winners

A two-layer perceptron with 6,344 weights, and the discovery that you can cut nineteen connections in twenty and it still works. The Lottery Ticket Hypothesis, arrived at from the inside.