Yes, the answer is simple.
This drastic difference between these LDs is because of the memory.
Studies show that even 5 seconds of deep sleep after a dream will diminish it's memory a lot.
The problem is that most of the richness of the experience is lost because you fell back to deep sleep after the LD.
What you should do is, after completing your LD goal, wake yourself up. This will leave the memory of the experience intact, and you'll feel like you were just there, not like feeling it as a distant memory.
Also supplements help, because they make your memory save more details of the dream.

Side note: Try to shout at the dream "Clarity Now!"
This will add more details to the dream, turn it HD lol

Hope I helped, and ask me more if you want to