I would guess that most people see the colors the same way, and this could be proven with experiments as stated above.
However, it is very possible that a small amount of people actually see the colors differently, and they have no idea that this is the case.