I use 8mm square insert holders on both my 180 lathe and the Flexispeed. I have not gone as small as 6mm square.
The Flexispeed only uses the ground finish CCGT060204 and DCGT070204 inserts, 8mm gets me to centre height with minimal shimming. I don’t bother trying to part off on the Flexispeed.
I use 10mm square tooling on the 180 lathe when I have to have more tool overhang. Still using the CCGT060204 and DCGT070204, but also on occasion the CCMT and DCMT versions, depends on the material. I also have some VCMT/VCGT 1103 tooling in 10mm should the need arise.
I didn’t buy any of my tooling in sets, only as required.
I use the insert tooling to save me having to grind up HSS, I only use HSS for specials now.
Just one observation on inserts, the third letter ( M or G) actually refers to a tolerance band. On turning inserts this seems to imply a ground finish, but on milling inserts it might not, you have to check the specification. I got caught out on milling inserts once.
Neil