Nah, don't worry. Recall can fluctuate (even with a skilled dreamer). Just keep practicing and your recall will build up to where these lapses in recall are few and far between.