Terahertz Magnetism From Non-Magnetic Materials