Created: September 14, 2022
Modified: September 14, 2022
Modified: September 14, 2022
important neural net phenomena
This page is from my personal notes, and has not been specifically reviewed for public consumption. It might be incomplete, wrong, outdated, or stupid. Caveat lector.- grokking / phase change hypothesis
- emergence of near-discrete features in large transformers
- symmetries / non-identifiability