I have this problem when I wake up in the morning and immediately thinking about other things before recalling.
It's more annoying when a minute later you're like "Wait! I forgot to recall my dream!"
Is there any ways to fix this?