Castings are definitely a mixed blessing Garry.
For your castings I'd do exactly as Jason advises and clean it up and then very lightly machine your reference surface. It's easy to assume that a casting has enough 'meat' all around and to try to get down to a clean surface on the first pass – and then you find that there is not enough left elsewhere to end up with the stated dimensions.
I've recently machined several pairs of cylinder castings for use in a published locomotive design. There wasn't enough metal to get smooth surfaces all around in either pair- so you really have to decide where to compromise or simply change the design. For these castings of yours (and any other castings involved) it will pay to look at the item "in the round" and make sure you don't have to adjust something before you start.
In the cylinders I had to balance the machining at each end-face because the friend I was doing them for had already ordered laser cut frames (to the drawing) and the cylinder cut-out is oversize to the available metal in the castings supplied. Both ends could have been cut back to clean surfaces if the frame cut-out could have been reduced. The design also specified a 1/2" bore but on both cylinder sets the core was already 12mm and the cores weren't central either (one cylinder was offset by nearly 3mm) so to bore & ream them to the given size was impossible.
The flanges need to be symmetrical to the body, so I always set-up based on those (rather than the bores). The final bore size (pre-reaming) on this pair was about 16mm & I obviously had to do both cylinders the same. I'm sure it will all pan out but with castings you really have to have a good look at them and think ahead a bit.
In many ways small fabrications, whilst they need more work up-front, are a bit easier when you come to actually machine them.
Regards,
IanT

Edited By IanT on 20/12/2019 17:25:53