Hi,

Have you consideerd starting up conversation with him about this topic and asking him why does he acts so mean and does that to you.
Since he has personality of his own he probably has his own reasons to stop you or break your lucid experiences up aswell?

He might be maybe trying to protect you from something?