It isn't too early at all. You can fall asleep in a lot less time than 20 minutes.