Hot wallet

As Ledger faces public backlash, let's take this opportunity to remind ourselves what a seed is, the concept of cold/hot wallets, and how BTC transactions work.

What is a seed? Is it possible for someone to guess it? What are the chances of that happening? What is the seed used for?