There's clearly a lot of fear, verging on hysteria, about the hazards that surround us. A lot of it is amplified by the bureaucrats who seem to want to think for us and/or instruct us how to think. Keep the public anxious, in ignorance and submissive. Create the illusion that the masters are lovingly looking after the people, wrapping them snugly in cotton-wool and keeping the nasty, scary things away. When you're lying on the floor, paralysed with fear about all this, it's worth finding out what the greatest dangers to life and limb are – and what the government isn't doing about them…
Elemental Hg (and Pb – also hysterically demonized) really aren't that risky: it is unusual to be in a situation where significant absorption is likely. Anyone should know that inhaling fumes of more-or-less anything (including tobacco and other combustion products, of course) is to be avoided. Some heavy metal compounds – some salts and, particularly, some organic compounds are, however, horribly toxic. That includes some compounds of gold. Some gold compounds were (still are?) used to treat inflammatory arthritides. IIRC, the safe dose range was very narrow. Gold is a toxic metal! OK, again, elemental gold is 'safe', although it's, surprisingly, a recognised allergen. Perhaps our 'protectors' should ban gold, just to be on the safe side…
On a less cynical note, one metal that really is an 'everyday' danger to model engineers is copper. If you ever suspect that you have a penetrating eye injury (and this can be surprisingly painless, at the time) due to copper, or copper-alloy swarf, for goodness' sake please panic: get to A&E pronto (and make sure they understand the possibility of Cu in your eye). Copper destroys eyes, very quickly!