Pinned
How does scaling up neural networks change what they learn?
Despite its importance, our understanding of this question remains nascent.
I've written a long post reflecting on my model of neural scaling and its relationship to interpretability, etc.:
ericjmichaud.com/quanta
