If its just for a second in Windows startup, just ignore it.
If it happens all the time, try putting the card in another slot, try to play around with the PCIe settings in the BIOS.
You can try this registry entries:
Then I would suspect the problem is with your hardware or perhaps a software configuration issue. These drivers listed above have been tested. Have you tried a fresh install of Windows on a spare drive with the drivers above to rule out software configuration problems? Two different computers...
www.techpowerup.com
If nothing helps, try to plug it in another PC with different speakers and electric socket, if it still appears RMA the card.