Markov decision process: Nonlinear Function
Created:
Modified:

Markov decision process

This page is from my personal notes, and has not been specifically reviewed for public consumption. It might be incomplete, wrong, outdated, or stupid. Caveat lector.
Links to this note

worldly objective

This may be a central point of confusion: how do we define AI systems that have preferences about the real world , so that their goals and…

objectives are big

A very incomplete and maybe nonsensical intuition I want to explore. Classically, people talk about very simple [ reward ] functions like…

values all the way down

The standard [ Markov decision process ] formalism includes a reward function ; the total (discounted) reward across a trajectory is its…

generative flow network

Many objects can be generated by a sequence of actions. For example: Generating language by adding one word at a time Generating a molecule…

reward shaping

Suppose we have a [ Markov decision process ] in which we get reward only at the very end of a long trajectory. Until that point, we have no…

Meta