FWIW
When I needed to make male and female tapers that matched, having set over the Top Slide, I turned and bored the tapers without disturbing the setting.
Having had an open ended 2 – 3 MT sleeve stuck in the Mill (With a drawbar hole too small in diameter to be able to use a brass drift ) I made up a crude puller with a split end that could be pushed through the sleeve, and then expanded by pulling a taper into it. The rim of the split "top hat" piece then sat on the end of the sleeve and tightening a 1/4 BSF (Could be M6 ) nut pulled the sleeve free. Has worked every time when needed.
Howard