What's the difference between volatile and non-volatile memory?

What's the difference between volatile and non-volatile memory?
Volatile and non-volatile memory are both vital parts of modern computers and devices, but how do they work together?