Just because you know what's on the other side of the fence doesn't mean that the brain can render the scene any faster. The first time I had trouble rendering was outside my grandfather's house, where I am all the time. It's the change in scenery that throws our minds. Going from the forest to the field takes a while.

Remember, parts of the brain are shut off.