Ian, it depends on the type of rubber. Some are denser than others. And here's the biggie; water does compress! Not much but enough that the dielectric constant changes measureably. Back in the early '70s we did the experiments while investigating the use of pure water for high voltage insulation. Neat stuff.
Pete