Rollpins, of the size that you seem to have don't require a huge force to refit them. I could imagine that a 4 oz hammer would suffice. You are looking to overcome friction and compress the split rollpin. For the same interference, you would not be able to drive a solid dowel into place!
If possible refit the rollpins to the pulley and hub, before refitting to the lathe.
before tearing everything apart, turn up a counterebored dolly, so that you can use the central setscrew to press the pulley onto the shaft. In this way you will not be putting any impact load onto the bearings.
A large thick washer, and the setscrew might be the impact free method of refitting the rollpins, (doing both at once with care )?
Howard