You want a Rotary Table, so this look like the ideal opportunity to buy one.
You will need to centralise the R T under the Mill Spindle, then lock the one axix, (Y would be my choice).
Since you are making a flange, the material will, presumably, be thin enough to allow use of an End Mill.
Having fixed the workpiece to the R T , (drill holes into the stock to allow it be clamped using nuts on studs in T nuts in the slots in the R T), and traverse the table in the X axis to the (Outer Radius plus Half Cutter dia). This should produce the O D. The R T should be rotated against the direction of rotation of the milling cutter.
If you are able, set as much as possible of the cutter over the material, and use downfeed to apply the cut.
Based on my limited experience, the feed (Table rotation) needs to be fine. It may help to damp vibration, if the table is lighlty clamped, This will increase the load that you apply to the handle, but will lessen the tendency to "bounce" between cutter teeth contacting the work.
Having produced the O D., the table should be traversed to the point where the cutter will produce the I D.
It would be a good idea to traverse the Mill Table and the R T to drill the holes in the Flange, before producing the Inner diameter.
It may be worth returning to the centre position, and then resetting to the radius for the drilled holes, and to (Inner Radius minus Half Cutter dia).before down feeding for the initial cut with the End Mill, and commencing rotation for the I.D.
You will then, effectively, produce the flange by trepanning it.
A Slotting drill can be fed down to whatever depth of cut that is apprpriate to the rigidity of machine, R T and cutter because it is centre cutting. Unless your End Mill is centre cutting, initially, the maximum depth of cut will be limited by the depth between the teeth and the cutter body.
Although, probably you will not want to be taking heavy cuts or feeding hard. An End Mill would probably not want a feed rate of more than 0.002"/tooth.
Howard