Yeah, my rc's don't always work either. To counter this, I don't use a standard rc. I like to look at my environment and try doing something in it. Once I toppled a car, other times I push my hand through things. Or you could try doing more than one rc and see if that helps.
Good Luck!