Skip to contentExperiment
Predicting to choose an action
Explore longer horizons and the risk of inaccurate predictions.
Essentials
How it works
A world model predicts useful aspects of an environment’s evolution. DreamerV3 learns behaviours on imagined trajectories in a latent model. MuZero combines a learned decision-relevant model with tree search.
Takeaway
These systems use predictions differently. Model errors can accumulate; looking farther ahead does not guarantee a better decision. Our toy does not run either algorithm.
Scientific sources
- Hafner et al. · 2023Mastering Diverse Domains through World ModelsDreamerV3 · arXiv v2 · 2024Original publication
- Schrittwieser et al. · 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned ModelarXiv v2 · 2020Original publication
Teaching synthesis of the cited sources. Published results remain tied to their tasks, protocols and budgets.