The Stochastic Parrot
Contrary to how it may seem when we observe its output, an LM is a system for haphazardly stitching together sequences of linguistic forms it has observed in its vast training data, according to probabilistic information about how they combine, but without any reference to meaning: a stochastic parrot.
Emily M. Bender, Timnit Gebru, et al. (2021)
What it means
TODO
Where it came from
TODO
What it looks like in practice
TODO
What changes with AI
TODO
The key takeaways
TODO
Summary
TODO