Just a theory this...

on how recall habit helps you to become lucid (only sometimes):

You achieve the habit of recalling your dreams on waking so that it becomes second nature. Sometimes in dreams does the waking process begin and, because of the recall habit, you automatically, reflexively begin to try recalling previous events and this can trigger lucidity?

Also, the accepted guidance on dream recall may be something along the lines of: "Wake up, stay still and remember as much of the dream as you can" but each individual will bring their own personality nuances to this, and some of those nuances may lead to more success in achieving lucidity than others. It might be worth researching the way individuals recall their dreams and structure that information, because some recall methods may be better than others.