The convenience of magnets is indisputable but be careful what you stick on a magnet, especially so in a shop where metalwork is done.

Anything stuck to a magnet will become mildly magnetized itself; how powerful this transfer is depends on the power of the magnet. Then the tool itself becomes a magnet for every bit of ferrous fuzz, swarf or chips it nears. Swarf stuck to a cold chisel or hammer may not interfere with its use but swarf on a prick punch or caliper jaws can be a royal PIA. Think about how metallic fuzz will affect the use of the tool before you get it near a magnet.

You'll want to learn about the various shop tools and techniques for demagnetizing tools. A search of the forum will probably produce a comprehensive list of same.