Why are dreams more vivid later on during certain night's sleep?

Is it because of longer REM periods or something else?

yup

Yeah, your REM periods get longer. Also when you wake up you remember the dreams that were more recent more vividly than the ones early in the night.