I'd be interested in what people have to say about this too as sometimes I just lose all control.

I'm not that experienced but I think it's safe to say if you have more lucids they won't all be like that. Out of the ones I've had, I only lost control in two (and by control I mean like I couldn't move my body properly kinda how you were describing.)