A woodruff in an aluminium pulley might as well be mild steel- no point in using anything fancier. They shouldn't really be used for transmitting much torque anyway. The keyways are usually cut quite closely to nominal size. so I've parted off a disc a thou or so over, fitted with a file etc, then milled or more often sawn and filed to fit the pulley,
If a close fit isn't necessary, eg if you're loctiting it, just aim for nominal size and it'll be fine,