This may be a central point of confusion: how do we define AI systems that have preferences about the real world , so that their goals and…
A few ways to think about eligibility traces: an explicit accounting of credit assignment a [ sufficient statistic ] for the history of the…
Exponential Families, Conjugacy, Convexity, and Variational Inference Any parameterized family of probability densities that can be written…
When I was younger---in college or in grad school---I was sometimes conflicted about whether I should prioritize trying to get to correct…
References: Cooperative Inverse Reinforcement Learning The Off-Switch Game Incorrigibility in the CIRL Framework The CIRL setting models…
In kindergarten stats, you learn how to build a model that takes in data (a feature vector, image, sound file, etc) and predicts a single…
The tensor product of two vector spaces (defined on the same scalar field, we'll assume ) is the vector space of formal sums of…