I accidentally turned my file into a magnet?

I work as an Punch press operator in a sheet metal factory, and part of my job has me sanding parts with a metal file. Today I had some down time, so I was cleaning up using a magnet broom. I couldn't figure out how to make the broom let go of the metal scraps (apparently there's a handle somewhere) so I took my trusty file and scd the pieces off. When I got all the metal off the broom, I realized that my file is now a fairly powerful magnet, and its sticking to everything! It's a pain when I have to get into those tight spaces and the file keeps sticking to the wall. Does anyone know how to get rid of the magnetism?