Modified: March 16, 2022
high-dimensional
This page is from my personal notes, and has not been specifically reviewed for public consumption. It might be incomplete, wrong, outdated, or stupid. Caveat lector.Links to this note
neural nets don't just interpolate
Sometimes you'll see people say that neural nets 'just' memorize and interpolate their training data. No one denies that neural nets with…
mode-covering variational inference is incoherent
I have a [ strong opinion weakly held ] that doesn't seem to be wildly shared in the [ approximate Bayesian inference ] community: reverse…
probabilistic program induction
Can we think about [ generative flow network ]s as a potentially tractable formulation of probabilistic program induction?! executing a line…
kernel
multiple senses: in machine learning: positive definite (Mercer) kernels in linear algebra: kernel (nullspace) of a linear map in CS systems…
personal philosophy
I always found it weird that philosophy spends so much time talking about specific historical philosophers. Who cares what Aristotle, or…
things are deeply wrong
See also: [ the system is bad ] I find it hard to be okay with a 'normal' life, because that would imply some level of acceptance of the…
marijuana
I have a private theory about what marijuana does. I'll try to articulate it here. I don't know much about the public theories, so maybe…
AI safety
AI safety, as a term, is sterile and hard to get excited about. Preventing catastrophe is important, but doesn't motivate me, since [ the…
conceptual scaffolding
Related: Learning increasingly complex ideas may amount to forming larger effective chunk sizes Expertise requires increasingly…