It's rare day when I use small HSS milling cutters. Here's a 4mm carbide cutter machining a cast iron bevel gear:

There will be no problem using a carbide cutter to form ports. They have a high Young's modulus so don't tend to bend but will snap if mistreated.
The term solid carbide is incorrect. The tools are formed by sintering tungsten carbide in the form of a fine powder in a matrix of cobalt.
Andrew