I only use gloves for arc welding, silver-soldering and grinding. Gloves of choice are soft leather 'riggers' gloves. Not the most heat resistant but retain enough flexibility and 'feel' to make their use more tolerable than anything tougher. Most other tasks I let my bare hands take the brunt of the punishment, but then I'm generally pretty cautious about things that revolve at high speed and spit out bits of metal so have not had any problems so far. Always turn things off before removing swarf, or else use an old paint brush to sweep it away. Not concerned with grease and oil, a good hand cleaner (Orange Scrub by Septone is my choice) gets rid of the majority, the rest disappears when washing the dishes. And yes, I always deburr my cut ends before doing anything else with them.