Dreaming with Eyes Open?

A few times over the past year, I have had dreams in which I am looking at something, either in my room or out the window. However, it is difficult to focus on the one object because my eyes spin around or dart from side to side. Is this still REM sleep? I have experienced this in the middle of the night (looking at a dusk-to-dawn light out the window) and in the morning (looking at objects in the room.) There is always a type of dialogue going on as well, making it undoubtedly a dream. I am most interested in finding out if this is indeed REM sleep. Thank you for any insight and explanation.