I'm not sure remembering everything is necessarily desirable. Where's the mystique? The nostalgia? In faded or fake memories. Remembering things, ie pieces of text, doesn't usually guarantee an understanding of something either, so don't worry about it too much. I'm sure it's better in theory than it is in practice.

Memory can be improved through acquiring new techniques, such as association and increased active memory practice. I have a terrible memory, but I'm not sure I lose out in the end. Some nights, it's for the best.