One nice thing about EN24 is that it doesn't distort or change size noticeably with hardening. You should be able to use EN24T for a couple of holes in gunmetal without issues.
If it does go badly, you can always clean up the cutting edges and get the broach up to the mid 50's HRC with an oil quench.
To be honest, the T condition EN24 machines much more nicely than the annealed condition. It's a bit grabby when annealed, but cuts cleanly (with straw or blue chips) in the T condition.
Hey Grandma! Do you know how to suck eggs? 