Because it never works that way?
Usually, stuff enter your left ear and goes straight out of the right ear.
You have to make notes to remember... but then you would have to read.
And a book can serve as future reference if and when you forget.

It's simply the way we and the world works, I'm afraid.