Try the card upside down, meaning the fan facing upwards aka BTX :p
I can imagine that the weight of the magnet inside the 'rotor' (the piece of the fans motor, with the blades on it) is affected by gravity, pulling it out of natural 'center' position. If the fan is idle (low speed) the...