Shimming is your only choice if you want to keep the bearings. I just had to do this to diagnose worn out bearings on my surface grinder.
Measure the end-float with a dial gauge then get some shim stock sandwiched between two pieces of scrap. Drill it through then turn the outside then you'll have the correct annular shim. You can do ID or OD depending on how you orientate the bearings.