You don’t even need a rivet, a piece of whatever type of material you are using put in to the countersunk hole can be hammered in using a ball pein hammer to close it into the hole.
The try squares I made 60 years ago and still use were made this way, no sign of the joint or rivets showing.