Well, it doesn't really make a difference to me (as Aquanina said). I mean, as long as I go to sleep sober, and not high, I don't notice a complete difference. But as you said, it does cloud your memory a bit, so it could be impairing in recall sense.

Hope that answered your question!