I actually think it's the work of your Guardian Angel.

If your angel has doubts about your motivations, and/or is generally uncomfortable with you, it is doubtful that they will let you into their realm. However, it is entirely possible to come into balance with your angel's needs etc. as well as to dis-illusion the dis-trust you may have built.

Often times, people have amazing relationships with their GA's without even noticing it. It is a necessity, IMO, for each person who is an experienced Lucid Dreamer, to come to know their GA on a personal level.