What prevents us from lucid dreaming?

Off the top of my head, I don’t feel that it is a biological/physiological mechanism preventing or enabling lucidity. I think lucidity is more esoteric and psychological, mystic and of the mind and that it, like waking consciousness, is one of the last great unexplored mysteries of existence.