From what I can see of the fracture, (a blow up of this would have been helpful). The pin is “case hardened” and has a soft core. Any commercial dowel is going to be of the same construction. A Needle roller in this size would probably be hardened all the way through, but may well be tempered for maximum hardness and thus could be too brittle for this application.
The shank of a HSS 4mm Drill will be soft as you have already found out. An Allen Cap screw shank will not give you a much better performance than Silver Steel which is soft. Which you have tried.
Round HSS tool or Drill blanks would I suspect be the best way to go. Drill blanks in particular will be on size if you purchase from the likes of Dormer, etc.
Without hardening and tempering facilities for Silver Steel I would be inclined to go for the Drill Blank option, but these may well be down on size and not a press fit. High strength Loctite would be my choice here, a grade that will tolerate oil.
Was the shank of the 4mm Drill a “press fit”?
I know it would have been down on 4mm by about 0.025mm, so I am really wondering if you do not want 5/32″ diameter material. This assumption is based on the bike being a Norton.
Regards
Gray,
PS I would replace all 3 with the new material, it will always fail at the weakest point.