John
Seriously consider going for sidelock (weldon) holders. Decent quality cutters with suitable flats are readily available at negligible price premium over straight shank. Similar pull out resistance to threaded cutters and no need for the very high tightening torques demanded by ER systems.
Like you I mostly use threaded shank cutters. Although I bought an ER set early on it pretty much never gets used. My, relatively few, straight shank cutters almost invariably go in native spindle fit collets.
I'm slowly transitioning to sidelock having bought a set of holders. Any new cutters I buy have flats. Huge stash of threaded ones to use up.)
Sidelock holders always seem expensive in comparison to ER collet sets tho'.
One nice advantage is that you can have more than one cutter size mounted and ready to go. A great help when a job needs more than one cutter size. Especially if you have several of one part to do. Cutter projection remains the same when changing over which makes life easier when being creative with the zero position memories on a DRO set.
Arguably its worth having enough sidelock holders the one cutter of each size you use is set-up and ready to go.
Clive