Bearing manufacturers web sites typically give information on fitting bearings – including housing / shaft dimensions.
In some cases you may want slightly different dimensions for each bearing (axial movement allowed at one bearing to allow for shaft thermal expansion).
If you accidentally cut too much material away, there are 'bearing fit' adhesives available that can save the day (widely used in industry beacuse quicker/cheaper than close tolerance machining).