Skip to contentExperiment
Learning, then using a model
Separate learned parameters from information supplied with a request.
Essentials
How it works
Training adjusts parameters to reduce a loss or increase a reward. The objective, data and optimisation procedure shape what is learned. At inference, the model uses its parameters and available context to compute an output.
Takeaway
Changing instructions changes the input; it does not necessarily retrain parameters. Supervised learning, self-supervised learning and reinforcement learning describe methods, not architectures.
From concept to practicePut it into practice
Scientific sources
- Vaswani et al. · 2017Attention Is All You NeedarXiv v7 · 2023Original publication
- Hafner et al. · 2023Mastering Diverse Domains through World ModelsDreamerV3 · arXiv v2 · 2024Original publication
Teaching synthesis of the cited sources. Published results remain tied to their tasks, protocols and budgets.