Hello ,
It will cease to be a problem sometime but could be weeks .
Usually at it’s worst when the solder has not penetrated 100% and there is still flux residue in cracks in the joint .
Flux residue does not dissolve very well in cold water so try carefully boiling the parts for 20 minutes or so – normally works .
Regards ,
MikeW