• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

Intel's Atom C2000 chips are bricking products – and it's not just Cisco hit

Joined
Jan 5, 2006
Messages
17,791 (2.66/day)
System Name AlderLake / Laptop
Processor Intel i7 12700K P-Cores @ 5Ghz / Intel i3 7100U
Motherboard Gigabyte Z690 Aorus Master / HP 83A3 (U3E1)
Cooling Noctua NH-U12A 2 fans + Thermal Grizzly Kryonaut Extreme + 5 case fans / Fan
Memory 32GB DDR5 Corsair Dominator Platinum RGB 6000MHz CL36 / 8GB DDR4 HyperX CL13
Video Card(s) MSI RTX 2070 Super Gaming X Trio / Intel HD620
Storage Samsung 980 Pro 1TB + 970 Evo 500GB + 850 Pro 512GB + 860 Evo 1TB x2 / Samsung 256GB M.2 SSD
Display(s) 23.8" Dell S2417DG 165Hz G-Sync 1440p / 14" 1080p IPS Glossy
Case Be quiet! Silent Base 600 - Window / HP Pavilion
Audio Device(s) Panasonic SA-PMX94 / Realtek onboard + B&O speaker system / Harman Kardon Go + Play / Logitech G533
Power Supply Seasonic Focus Plus Gold 750W / Powerbrick
Mouse Logitech MX Anywhere 2 Laser wireless / Logitech M330 wireless
Keyboard RAPOO E9270P Black 5GHz wireless / HP backlit
Software Windows 11 / Windows 10
Benchmark Scores Cinebench R23 (Single Core) 1936 @ stock Cinebench R23 (Multi Core) 23006 @ stock
Chipzilla and Switchzilla won't confirm connection but the writing is on the wall


"Intel's Atom C2000 processor family has a fault that effectively bricks devices, costing the company a significant amount of money to correct. But the semiconductor giant won't disclose precisely how many chips are affected nor which products are at risk.

On its Q4 2016 earnings call earlier this month, chief financial officer Robert Swan said a product issue limited profitability during the quarter, forcing the biz to set aside a pot of cash to deal with the problem.

"We were observing a product quality issue in the fourth quarter with slightly higher expected failure rates under certain use and time constraints, and we established a reserve to deal with that," he said. "We think we have it relatively well-bounded with a minor design fix that we're working with our clients to resolve."

Coincidentally, Cisco last week issued an advisory warning that several of its routing, optical networking, security and switch products sold prior to November 16, 2016 contain a faulty clock component that is likely to fail at an accelerated rate after 18 months of operation.

Cisco at the time declined to name the supplier of that component. When asked on Monday whether Intel supplied the faulty electronics, a Cisco spokesperson told that The Register that the networking giant does not intend to publicly name the supplier.

Intel indicated in a January 2017 revision of its Atom C2000 family documentation that the chip line contains a clock flaw. Errata note AVR.54, titled "System May Experience Inability to Boot or May Cease Operation," explains that the Atom C2000 Low Pin Count bus clock outputs (LPC_CLKOUT0 and LPC_CLKOUT1) may stop functioning. Permanently.

An Intel spokesperson in an email to The Register characterized the issue as "a degradation of a circuit element under high use conditions at a rate higher than Intel’s quality goals after multiple years of service."

"If the LPC clock(s) stop functioning the system will no longer be able to boot," Intel's documentation explains.

This consequence is precisely what Cisco says may happen to its devices given enough time. "Once the component has failed, the system will stop functioning, will not boot, and is not recoverable," Cisco's advisory states.

The Register asked Intel whether it could confirm that Cisco's advisory could be attributed to an Intel component. Intel said it could not confirm or deny whether its chip issue is the one affecting Cisco gear, citing a policy of not commenting on customers. We note that the affected Cisco ASA 55xx products use Intel's Atom C2000 system-on-chips at least."

Radio silence
"We asked Intel to provide specific details about when it began and stopped shipping Intel Atom C2000 processors with faulty clock outputs. Intel declined to comment. The official errata says the B0 stepping of C2xxx Atoms are vulnerable to failure, and these parts began shipping in 2013. The specific SKUs are:

C2308, C2338, C2350, C2358, C2508, C2518, C2530, C2538, C2550, C2558, C2718, C2730, C2738, C2750, and C2758.
We asked Intel how many affected Atom C2000 chips have been shipped and how much fixing the issue will cost the company. Intel declined to comment.

Intel did, however, provide some insight on how the Atom C2000 flaw might be addressed. "A board level workaround exists for the existing production stepping of the product which resolves the issue," a company spokesperson said in an email. "Additionally, Intel will implement and validate a minor silicon fix in a new product stepping that resolves this issue."

Many other technology vendors make products with Intel Atom C2000 processors, including Dell and Synology. The Register pinged Dell via email, and it was not immediately available for comment.

People with Synology DS1815+ storage boxes have been reporting complete hardware failures; the DS1815+ is powered by an Intel Atom C2538.

Other vendors using Atom C2000 chips include Asrock, Aaeon, HP, Infortrend, Lanner, NEC, Newisys, Netgate, Netgear, Quanta, Supermicro, and ZNYX Networks. The chipset is aimed at networking devices, storage systems, and microserver workloads. If you know of any affected or failed gear, please let us know.

According to this Intel data-sheet [PDF], LPC_CLKOUT0 and LPC_CLKOUT1 are driven by the processor to provide essential timing signals to hardware on the board, including the boot ROM. If these signals stop ticking, the rest of the electronics stops, too. ®
"

Updated to add at 14:29 UTC, February 7
"Synology told The Reg it was "investigating this issue together with Intel," saying it would "provide more detailed information in the week as it becomes available."

It added: "At this time Synology has not seen any indication that this issue has caused an increase in failure rates for DiskStation or RackStation models equipped with Intel Atom C2000 series processors. However once additional information is available, Synology will post an advisory on this topic.

"In the meantime it is still safe to continue to use your device, however should you encounter any issues these will be handled via our support teams and all the devices are still covered under the standard warranty provided with all our units. Technical Support can be reached via www.synology.com/ticket.
""

Updated to add at 15:36 UTC, February 7
"Synology subsequently asked to have its statement above revised to omit any mention of Intel."

Updated to add at 18:23 UTC, February 8
"Once again, Synology has been in touch, seemingly now able to use the I word, to say: "Intel has recently notified Synology regarding the issue of the processor’s increased degradation chance of a specific component after heavy, prolonged usage.

"Synology has not currently seen any indication that this issue has caused an increase in failure rates for DiskStation or RackStation models equipped with Intel Atom C2000 series processors compared to other models manufactured in the same time frame not equipped with the affected processors.
""

https://www.theregister.co.uk/2017/02/06/cisco_intel_decline_to_link_product_warning_to_faulty_chip/
 
Joined
Mar 31, 2010
Messages
498 (0.10/day)
System Name Dell Vostro 5630 | PHaS3-XXI
Processor Intel Core i7 1360P | AMD Ryzen 7 5700X PBO
Motherboard Asus ROG Strix B450-F Gaming
Cooling Corsair H105 (AM4 Retention yay!)
Memory 16GB Quad Channel LPDDR5 4800 | Crucial 64GB DDR4 Pro 3200 C16
Video Card(s) Nvidia RTX 2050 | Gigabyte Radeon RX 5700 Stock Cooler @ XT BIOS
Storage Kioxia 512GB NVMe |Crucial MX200 SSD + Samsung 980 1TB + 870QVO 1TB + 12TB HDDs
Display(s) Dell Laptop Display 1920x1200 | Dell UltraSharp U2719D
Case Fractal Design Define R4
Power Supply Corsair RM750
Mouse Logitech G403 | Logitech G Pro
Keyboard Logitech MX Keys
Software Windows 11 Pro x64
Benchmark Scores @_@

Toothless

Tech, Games, and TPU!
Supporter
Joined
Mar 26, 2014
Messages
9,268 (2.52/day)
Location
Washington, USA
System Name Veral
Processor 5950x
Motherboard MSI MEG x570 Ace
Cooling Corsair H150i RGB Elite
Memory 4x16GB G.Skill TridentZ
Video Card(s) Powercolor 7900XTX Red Devil
Storage Crucial P5 Plus 1TB, Samsung 980 1TB, Teamgroup MP34 4TB
Display(s) Acer Nitro XZ342CK Pbmiiphx + 2x AOC 2425W
Case Fractal Design Meshify Lite 2
Audio Device(s) Blue Yeti + SteelSeries Arctis 5 / Samsung HW-T550
Power Supply Corsair HX850
Mouse Corsair Nightsword
Keyboard Corsair K55
VR HMD HP Reverb G2
Software Windows 11 Professional
Benchmark Scores PEBCAK
Yes Intel, leave my N270 alone so I can keep "testing" it.
 
Joined
Jan 12, 2010
Messages
1,526 (0.29/day)
System Name Custom Built
Processor AMD Ryzen 5 3600
Motherboard Asus PRIME A520M-A
Cooling Stock heatsink/fan
Memory 16GB 2x8GB Corsair Vengeance LPX 2400MHz
Video Card(s) MSI 1050Ti 4GB
Storage KINGSTON SNVS250G 256GB M.2 + 2 data disks
Display(s) Dell S2421NX
Case Aerocool CS103
Audio Device(s) Realtek
Power Supply Seasonic M12II-520 EVO
Mouse Logitech MX Master 2S
Keyboard Logitech
Software Windows 11 Pro 64-bit
LOL @ some sensationalist headlines that say that Atom chips (like if all of them were affected) are dying.

Anyway hardware bugs are so nasty :(
 
Last edited:
Joined
Mar 10, 2010
Messages
11,878 (2.30/day)
Location
Manchester uk
System Name RyzenGtEvo/ Asus strix scar II
Processor Amd R5 5900X/ Intel 8750H
Motherboard Crosshair hero8 impact/Asus
Cooling 360EK extreme rad+ 360$EK slim all push, cpu ek suprim Gpu full cover all EK
Memory Corsair Vengeance Rgb pro 3600cas14 16Gb in four sticks./16Gb/16GB
Video Card(s) Powercolour RX7900XT Reference/Rtx 2060
Storage Silicon power 2TB nvme/8Tb external/1Tb samsung Evo nvme 2Tb sata ssd/1Tb nvme
Display(s) Samsung UAE28"850R 4k freesync.dell shiter
Case Lianli 011 dynamic/strix scar2
Audio Device(s) Xfi creative 7.1 on board ,Yamaha dts av setup, corsair void pro headset
Power Supply corsair 1200Hxi/Asus stock
Mouse Roccat Kova/ Logitech G wireless
Keyboard Roccat Aimo 120
VR HMD Oculus rift
Software Win 10 Pro
Benchmark Scores 8726 vega 3dmark timespy/ laptop Timespy 6506
Joined
Jan 29, 2012
Messages
6,431 (1.44/day)
Location
Florida
System Name natr0n-PC
Processor Ryzen 5950x/5600x
Motherboard B450 AORUS M
Cooling EK AIO 360 - 6 fan action
Memory Patriot - Viper Steel DDR4 (B-Die)(4x8GB)
Video Card(s) EVGA 3070ti FTW
Storage Various
Display(s) PIXIO IPS 240Hz 1080P
Case Thermaltake Level 20 VT
Audio Device(s) LOXJIE D10 + Kinter Amp + 6 Bookshelf Speakers Sony+JVC+Sony
Power Supply Super Flower Leadex III ARGB 80+ Gold 650W
Software XP/7/8.1/10
Benchmark Scores http://valid.x86.fr/79kuh6
The empire falls soon.
 
Joined
Jan 13, 2016
Messages
660 (0.22/day)
Location
127.0.0.1, London, UK
System Name Warranty Void Mk.IV
Processor AMD Ryzen 5 5600
Motherboard Asus X470-I Strix
Cooling Arctic Freezer 240 + 2x Be Quiet! Pure Wings 2 140mm / Silverstone 120mm Slim
Memory Crucial Ballistix Elite 3600MHz 2x8GB CL16 - Tightened Sub-timings
Video Card(s) EVGA RTX 2080 XC Ultra
Storage WD SN550 / MX300 / MX500
Display(s) AOC CU34G2 / LG 29UM69G-B - Auxilary
Case CM NR200p / Silverstone RVZ03-B
Audio Device(s) Realtek ALC 1220+SupremeFX
Power Supply Corsair CX550M 550W / Silverstone SX650-G 650W
Mouse Logitech G302/G502/G203 / RPG: Corsair Nightsword
Keyboard CM Masterkeys Pro M / Asus Sagaris GK100
VR HMD Oculus Rift S
Software Windows 10 Pro x64 - LTSB
Joined
Apr 12, 2013
Messages
6,743 (1.68/day)
So apparently this has been going on for 18 months or so ~ https://www.theregister.co.uk/2017/02/07/intel_atom_failures_go_back_18_months

So either the likes of Cisco, Synology, Netgate, Seagate et al didn't know what was going on or that the Chipzilla didn't want this to be in the news, possibly threatened the OEM's with backlash or whatever :shadedshu:
LOL @ some sensationalist headlines that say that Atom chips (like if all of them were affected) are dying.

Anyway hardware bugs are so nasty :(
Good luck trying to fix this bug when your NASes are failing left right & center :rolleyes:
 
Last edited:
Joined
Jan 4, 2017
Messages
431 (0.16/day)
Location
Ohio
I guess it's a good thing that most of our Cisco devices were manufactured long before 2013...:(
 

eidairaman1

The Exiled Airman
Joined
Jul 2, 2007
Messages
40,435 (6.59/day)
Location
Republic of Texas (True Patriot)
System Name PCGOD
Processor AMD FX 8350@ 5.0GHz
Motherboard Asus TUF 990FX Sabertooth R2 2901 Bios
Cooling Scythe Ashura, 2×BitFenix 230mm Spectre Pro LED (Blue,Green), 2x BitFenix 140mm Spectre Pro LED
Memory 16 GB Gskill Ripjaws X 2133 (2400 OC, 10-10-12-20-20, 1T, 1.65V)
Video Card(s) AMD Radeon 290 Sapphire Vapor-X
Storage Samsung 840 Pro 256GB, WD Velociraptor 1TB
Display(s) NEC Multisync LCD 1700V (Display Port Adapter)
Case AeroCool Xpredator Evil Blue Edition
Audio Device(s) Creative Labs Sound Blaster ZxR
Power Supply Seasonic 1250 XM2 Series (XP3)
Mouse Roccat Kone XTD
Keyboard Roccat Ryos MK Pro
Software Windows 7 Pro 64
Atom sucked 10 years ago, it sucks today, shovelhardware
 

qubit

Overclocked quantum bit
Joined
Dec 6, 2007
Messages
17,865 (2.99/day)
Location
Quantum Well UK
System Name Quantumville™
Processor Intel Core i7-2700K @ 4GHz
Motherboard Asus P8Z68-V PRO/GEN3
Cooling Noctua NH-D14
Memory 16GB (2 x 8GB Corsair Vengeance Black DDR3 PC3-12800 C9 1600MHz)
Video Card(s) MSI RTX 2080 SUPER Gaming X Trio
Storage Samsung 850 Pro 256GB | WD Black 4TB | WD Blue 6TB
Display(s) ASUS ROG Strix XG27UQR (4K, 144Hz, G-SYNC compatible) | Asus MG28UQ (4K, 60Hz, FreeSync compatible)
Case Cooler Master HAF 922
Audio Device(s) Creative Sound Blaster X-Fi Fatal1ty PCIe
Power Supply Corsair AX1600i
Mouse Microsoft Intellimouse Pro - Black Shadow
Keyboard Yes
Software Windows 10 Pro 64-bit
Wot, Intel bricking stuff?! No no @P4-630 that cannot be true. I will now hurl appropriate ranting fanboy abuse at you at such allegations of my favourite processor company!

Just gimme a couple of minutes to work myself into a suitably angry and incoherent state. :roll:
 
Joined
Nov 2, 2008
Messages
887 (0.16/day)
Processor Intel Core i3-8100
Motherboard ASRock H370 Pro4
Cooling Cryorig M9i
Memory 16GB G.Skill Aegis DDR4-2400
Video Card(s) Gigabyte GeForce GTX 1060 WindForce OC 3GB
Storage Crucial MX500 512GB SSD
Display(s) Dell S2316M LCD
Case Fractal Design Define R4 Black Pearl
Audio Device(s) Realtek ALC892
Power Supply Corsair CX600M
Mouse Logitech M500
Keyboard Lenovo KB1021 USB
Software Windows 10 Professional x64
An update: The B0 stepping of the Atom C2000 was the source of the failures. Intel has now announced the C0 stepping that fixes the problem. The big issue is that the processor is soldered to the system board, so repairing your equipment will require a replacement board from the vendor.

Intel redesigns flawed Atom CPUs to stave off premature chip death
http://www.theregister.co.uk/2017/04/27/intel_redesigns_atom_line/
 
Joined
Nov 2, 2008
Messages
887 (0.16/day)
Processor Intel Core i3-8100
Motherboard ASRock H370 Pro4
Cooling Cryorig M9i
Memory 16GB G.Skill Aegis DDR4-2400
Video Card(s) Gigabyte GeForce GTX 1060 WindForce OC 3GB
Storage Crucial MX500 512GB SSD
Display(s) Dell S2316M LCD
Case Fractal Design Define R4 Black Pearl
Audio Device(s) Realtek ALC892
Power Supply Corsair CX600M
Mouse Logitech M500
Keyboard Lenovo KB1021 USB
Software Windows 10 Professional x64

silentbogo

Moderator
Staff member
Joined
Nov 20, 2013
Messages
5,473 (1.44/day)
Location
Kyiv, Ukraine
System Name WS#1337
Processor Ryzen 7 3800X
Motherboard ASUS X570-PLUS TUF Gaming
Cooling Xigmatek Scylla 240mm AIO
Memory 4x8GB Samsung DDR4 ECC UDIMM
Video Card(s) Inno3D RTX 3070 Ti iChill
Storage ADATA Legend 2TB + ADATA SX8200 Pro 1TB
Display(s) Samsung U24E590D (4K/UHD)
Case ghetto CM Cosmos RC-1000
Audio Device(s) ALC1220
Power Supply SeaSonic SSR-550FX (80+ GOLD)
Mouse Logitech G603
Keyboard Modecom Volcano Blade (Kailh choc LP)
VR HMD Google dreamview headset(aka fancy cardboard)
Software Windows 11, Ubuntu 20.04 LTS
Some up-to-date news on the topic:
https://www.servethehome.com/intel-atom-c2000-series-bug-quiet/

Basically, by the time this bug may occur in a device - it will most likely be out of warranty. According to CISCO FAQ on the issue, LPC_CLK failure may occur no earlier than 18 months into exploitation period, and is more likely to happen near a 3-year mark. Most devices with this SoC come with 2 or 3 year warranty (like Synology NAS boxes), or even less (CISCO Nexus switches only come with 1-year warranty). Due to excessive publicity some vendors have already extended the warranty by a year or two, or deployed replacement plans for affected devices(pre-2017).
 
Joined
Mar 10, 2010
Messages
11,878 (2.30/day)
Location
Manchester uk
System Name RyzenGtEvo/ Asus strix scar II
Processor Amd R5 5900X/ Intel 8750H
Motherboard Crosshair hero8 impact/Asus
Cooling 360EK extreme rad+ 360$EK slim all push, cpu ek suprim Gpu full cover all EK
Memory Corsair Vengeance Rgb pro 3600cas14 16Gb in four sticks./16Gb/16GB
Video Card(s) Powercolour RX7900XT Reference/Rtx 2060
Storage Silicon power 2TB nvme/8Tb external/1Tb samsung Evo nvme 2Tb sata ssd/1Tb nvme
Display(s) Samsung UAE28"850R 4k freesync.dell shiter
Case Lianli 011 dynamic/strix scar2
Audio Device(s) Xfi creative 7.1 on board ,Yamaha dts av setup, corsair void pro headset
Power Supply corsair 1200Hxi/Asus stock
Mouse Roccat Kova/ Logitech G wireless
Keyboard Roccat Aimo 120
VR HMD Oculus rift
Software Win 10 Pro
Benchmark Scores 8726 vega 3dmark timespy/ laptop Timespy 6506
Some up-to-date news on the topic:
https://www.servethehome.com/intel-atom-c2000-series-bug-quiet/

Basically, by the time this bug may occur in a device - it will most likely be out of warranty. According to CISCO FAQ on the issue, LPC_CLK failure may occur no earlier than 18 months into exploitation period, and is more likely to happen near a 3-year mark. Most devices with this SoC come with 2 or 3 year warranty (like Synology NAS boxes), or even less (CISCO Nexus switches only come with 1-year warranty). Due to excessive publicity some vendors have already extended the warranty by a year or two, or deployed replacement plans for affected devices(pre-2017).
Sounds like a perfect peace of tech from some perspectives but by and large an expensive issue for intel , they have already respun the die to fix it though ,but it would be nice to know the exposure of this in units.
I meant the Cisco units but damn intel need to get on point.
 
Top