Magnetization of magnet is the total magnetic moment per unit volume. It is the summ of atom's magnetic moments. But the atom moments are rotate at random manner due to thermal fluctuations. It is result in demagnetization of our magnet with time. Let me to demonstrate it by following simulation.
