If the "bluing" shows only slight mismatches, you could then select a 2MT drill / arborl / whatever, in which you are confident, and use some fine grinding paste to lap the two together. Don't overdo it, check frequently, and clean thoroughly, before each check.
BUT, when checking afterwards, use a different arbor for any "blueing" checks.
Finally, when satisfied, clean the bore of the Mandrel really thoroughly.
Howard