Maybe it's the fact that e.g. when youre drunk and you remember fragments you think "did i really do that?" as you're thinking back from memory. In a lucid dream you are consciously aware of it being a dream and controlling it, but i guess when you wake up the fact that being aware you even had a dream at all is recalling and memory makes you think twice about whether you were ACTUALLY doing those things consciously or whether its a memory of you thinking you did it. This is with the sub conscious knowledge that you were asleep in your bed not physically doing anything with your body at the time and you woke up in the same place you went to sleep.

I guess when you think deeper on it, the fact you were there being aware of the dream and thinking that to yourself in the dream means lucidity anyway.......k im confusing myself and rambling but yeah my opinion on it because i know how you feel.