Oh yeah, this is super common. Sometimes it seems like your mind does all it can to keep you from becoming/staying lucid, lol. Just have to make sure you are ready to perform some RCs when in doubt. RCs can save your lucids!