• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

Ethernet Cluster Super Computer from Raspberry Pi article [Engadget]

Binge

Overclocking Surrealism
Joined
Sep 15, 2008
Messages
6,979 (1.23/day)
Location
PA, USA
System Name Molly
Processor i5 3570K
Motherboard Z77 ASRock
Cooling CooliT Eco
Memory 2x4GB Mushkin Redline Ridgebacks
Video Card(s) Gigabyte GTX 680
Case Coolermaster CM690 II Advanced
Power Supply Corsair HX-1000
Not sure if this is the best sub-forum for this, but considering the brain uses networking devices as the interconnect for cluster computing I figured this might be a pretty neat read.

Researchers at the University of Southampton have followed their instincts and built Iridis-Pi, a tiny 64-node cluster based on the Raspberry Pi's usual Debian Wheezy distribution and linked through Ethernet.

Source link in the article has DIY instructions for the system :toast:

http://www.engadget.com/2012/09/13/supercomputer-built-from-raspberry-pi-and-lego/
 
Joined
May 21, 2008
Messages
4,113 (0.71/day)
Location
Iowa, USA
System Name THE CUBE 2.0
Processor Intel i5 13600k
Motherboard MSI MPG Z690 EDGE DDR4
Cooling Phanteks PH-TC14PE BK 2x T30-120 Fan mod mount
Memory G.Skill TridentZ 3200 MT/s C15 32GB 2x16GB
Video Card(s) Gigabyte Aorus 1080 Ti 11GB OC: Core 2GHz, Mem 5.7GHz
Storage WD SN770 250GB / 3x WD SN850X 2TB / Toshiba X300 4TB / 2x RAID1 Toshiba P300 3TB
Display(s) Samsung 49" Odyssey OLED G95SC 240Hz 5120 x 1440
Case "THE CUBE" Custom built, pure Red Alder wood
Audio Device(s) Beyerdynamic DT 880
Power Supply Corsair RM1000X
Mouse Logitech G700
Keyboard Logitech G910
Software Windows 11 Pro
I want to see benchmarks :D

Here some pics.


 

FordGT90Concept

"I go fast!1!11!1!"
Joined
Oct 13, 2008
Messages
26,259 (4.65/day)
Location
IA, USA
System Name BY-2021
Processor AMD Ryzen 7 5800X (65w eco profile)
Motherboard MSI B550 Gaming Plus
Cooling Scythe Mugen (rev 5)
Memory 2 x Kingston HyperX DDR4-3200 32 GiB
Video Card(s) AMD Radeon RX 7900 XT
Storage Samsung 980 Pro, Seagate Exos X20 TB 7200 RPM
Display(s) Nixeus NX-EDG274K (3840x2160@144 DP) + Samsung SyncMaster 906BW (1440x900@60 HDMI-DVI)
Case Coolermaster HAF 932 w/ USB 3.0 5.25" bay + USB 3.2 (A+C) 3.5" bay
Audio Device(s) Realtek ALC1150, Micca OriGen+
Power Supply Enermax Platimax 850w
Mouse Nixeus REVEL-X
Keyboard Tesoro Excalibur
Software Windows 10 Home 64-bit
Benchmark Scores Faster than the tortoise; slower than the hare.
I bet they spent more on network switches than they did on processing power.


$4,026 is quite a lot of a cash--enough for a significant LGA-2011 two-way Xeon system. I wonder how it stands up, performance wise, to a 32-threaded, 2.0 GHz Xeon E5 2650 system. I bet it gets slaughtered by at least four fold.

Conclusion: waste of money.
 

W1zzard

Administrator
Staff member
Joined
May 14, 2004
Messages
26,958 (3.71/day)
Processor Ryzen 7 5700X
Memory 48 GB
Video Card(s) RTX 4080
Storage 2x HDD RAID 1, 3x M.2 NVMe
Display(s) 30" 2560x1600 + 19" 1280x1024
Software Windows 10 64-bit
I bet they spent more on network switches than they did on processing power.

i bet the network equipment has more processing power than the raspberry pis
 

Binge

Overclocking Surrealism
Joined
Sep 15, 2008
Messages
6,979 (1.23/day)
Location
PA, USA
System Name Molly
Processor i5 3570K
Motherboard Z77 ASRock
Cooling CooliT Eco
Memory 2x4GB Mushkin Redline Ridgebacks
Video Card(s) Gigabyte GTX 680
Case Coolermaster CM690 II Advanced
Power Supply Corsair HX-1000
I bet they spent more on network switches than they did on processing power.


$4,026 is quite a lot of a cash--enough for a significant LGA-2011 two-way Xeon system. I wonder how it stands up, performance wise, to a 32-threaded, 2.0 GHz Xeon E5 2650 system. I bet it gets slaughtered by at least four fold.

Conclusion: waste of money.

You bring up a very good point about the cost of the project. I'm not sure what application may utilize the ras pi setup to surpass something like a LGA-2011 setup you're suggesting. It would be awesome to have a head-to-head xD

Legos are cool. Performance wins every time.
 

FordGT90Concept

"I go fast!1!11!1!"
Joined
Oct 13, 2008
Messages
26,259 (4.65/day)
Location
IA, USA
System Name BY-2021
Processor AMD Ryzen 7 5800X (65w eco profile)
Motherboard MSI B550 Gaming Plus
Cooling Scythe Mugen (rev 5)
Memory 2 x Kingston HyperX DDR4-3200 32 GiB
Video Card(s) AMD Radeon RX 7900 XT
Storage Samsung 980 Pro, Seagate Exos X20 TB 7200 RPM
Display(s) Nixeus NX-EDG274K (3840x2160@144 DP) + Samsung SyncMaster 906BW (1440x900@60 HDMI-DVI)
Case Coolermaster HAF 932 w/ USB 3.0 5.25" bay + USB 3.2 (A+C) 3.5" bay
Audio Device(s) Realtek ALC1150, Micca OriGen+
Power Supply Enermax Platimax 850w
Mouse Nixeus REVEL-X
Keyboard Tesoro Excalibur
Software Windows 10 Home 64-bit
Benchmark Scores Faster than the tortoise; slower than the hare.
Number of USB ports? I honestly can't think of any situation where a Raspberry Pi cluster would be superior. Not to mention the complexity of having 64 (worker) + 1 (host) programs running simutaneously versus one program running 32 threads.
 

W1zzard

Administrator
Staff member
Joined
May 14, 2004
Messages
26,958 (3.71/day)
Processor Ryzen 7 5700X
Memory 48 GB
Video Card(s) RTX 4080
Storage 2x HDD RAID 1, 3x M.2 NVMe
Display(s) 30" 2560x1600 + 19" 1280x1024
Software Windows 10 64-bit

Binge

Overclocking Surrealism
Joined
Sep 15, 2008
Messages
6,979 (1.23/day)
Location
PA, USA
System Name Molly
Processor i5 3570K
Motherboard Z77 ASRock
Cooling CooliT Eco
Memory 2x4GB Mushkin Redline Ridgebacks
Video Card(s) Gigabyte GTX 680
Case Coolermaster CM690 II Advanced
Power Supply Corsair HX-1000
Number of USB ports? I honestly can't think of any situation where a Raspberry Pi cluster would be superior. Not to mention the complexity of having 64 (worker) + 1 (host) programs running simutaneously versus one program running 32 threads.

*grsnort* :roll: USB ports xD

The benefit here seems to be having such systems for education and instruction. They may not be uber powerful, but render farms for bigger applications are put to a more instructional scale. It's easy to move, disassemble, and visualize.
 
Last edited:
Joined
Aug 10, 2007
Messages
4,267 (0.70/day)
Location
Sanford, FL, USA
Processor Intel i5-6600
Motherboard ASRock H170M-ITX
Cooling Cooler Master Geminii S524
Memory G.Skill DDR4-2133 16GB (8GB x 2)
Video Card(s) Gigabyte R9-380X 4GB
Storage Samsung 950 EVO 250GB (mSATA)
Display(s) LG 29UM69G-B 2560x1080 IPS
Case Lian Li PC-Q25
Audio Device(s) Realtek ALC892
Power Supply Seasonic SS-460FL2
Mouse Logitech G700s
Keyboard Logitech G110
Software Windows 10 Pro
Cool. Awhile back I had a similar idea when they announced that future versions might be PoE powered.

Phase 1: Build Pi Cluster.
Phase 2: ?????
Phase 3: Profit!

Planned out phase 1:

- 48 10/100 port + 4 100/1000 port switch with PoE support, $600. (May not be cheapest, just the first one I found).

- 48 Raspberry Pis.

- Master node.

Unfortunately, I couldn't figure out phase 2...
 
Joined
May 21, 2008
Messages
4,113 (0.71/day)
Location
Iowa, USA
System Name THE CUBE 2.0
Processor Intel i5 13600k
Motherboard MSI MPG Z690 EDGE DDR4
Cooling Phanteks PH-TC14PE BK 2x T30-120 Fan mod mount
Memory G.Skill TridentZ 3200 MT/s C15 32GB 2x16GB
Video Card(s) Gigabyte Aorus 1080 Ti 11GB OC: Core 2GHz, Mem 5.7GHz
Storage WD SN770 250GB / 3x WD SN850X 2TB / Toshiba X300 4TB / 2x RAID1 Toshiba P300 3TB
Display(s) Samsung 49" Odyssey OLED G95SC 240Hz 5120 x 1440
Case "THE CUBE" Custom built, pure Red Alder wood
Audio Device(s) Beyerdynamic DT 880
Power Supply Corsair RM1000X
Mouse Logitech G700
Keyboard Logitech G910
Software Windows 11 Pro
I bet they spent more on network switches than they did on processing power.


$4,026 is quite a lot of a cash--enough for a significant LGA-2011 two-way Xeon system. I wonder how it stands up, performance wise, to a 32-threaded, 2.0 GHz Xeon E5 2650 system. I bet it gets slaughtered by at least four fold.

Conclusion: waste of money.

Very true, but these little guys won't use more than 450w for 64.

Performance Per watt
Pi>Xeon maybe?
Performane Per $
Pi<Xeon
 

FordGT90Concept

"I go fast!1!11!1!"
Joined
Oct 13, 2008
Messages
26,259 (4.65/day)
Location
IA, USA
System Name BY-2021
Processor AMD Ryzen 7 5800X (65w eco profile)
Motherboard MSI B550 Gaming Plus
Cooling Scythe Mugen (rev 5)
Memory 2 x Kingston HyperX DDR4-3200 32 GiB
Video Card(s) AMD Radeon RX 7900 XT
Storage Samsung 980 Pro, Seagate Exos X20 TB 7200 RPM
Display(s) Nixeus NX-EDG274K (3840x2160@144 DP) + Samsung SyncMaster 906BW (1440x900@60 HDMI-DVI)
Case Coolermaster HAF 932 w/ USB 3.0 5.25" bay + USB 3.2 (A+C) 3.5" bay
Audio Device(s) Realtek ALC1150, Micca OriGen+
Power Supply Enermax Platimax 850w
Mouse Nixeus REVEL-X
Keyboard Tesoro Excalibur
Software Windows 10 Home 64-bit
Benchmark Scores Faster than the tortoise; slower than the hare.
*grsnort* :roll: USB ports xD

The are benefit here seems to be having such systems for education and instruction. They may not be uber powerful, but render farms for bigger applications are put to a more instructional scale. It's easy to move, disassemble, and visualize.
True, if their objective is to train students how to program for *NIX clusters (which most research clusters are), this is a good, cheap alternative to everything else out there. A single, high-performance computer won't do a very job at that.


Very true, but these little guys won't use more than 450w for 64.

Performance Per watt
Pi>Xeon maybe?
Performane Per $
Pi<Xeon
The processors I linked are 95w TDP. My two-way server draws 300w continuous from the wall at 100% load. The system I described would be about the same, probably less, because I have 6 HDDs. They boasted about 1 TB of space--you can get three times that from a single hard drive for $140.

I can't find matching LINPACK tests ran on Raspberry Pi to compare to two-way systems of similar price. :( It should be easy to guesstimate with solid Xeon/Opteron figures.
 
Last edited:

W1zzard

Administrator
Staff member
Joined
May 14, 2004
Messages
26,958 (3.71/day)
Processor Ryzen 7 5700X
Memory 48 GB
Video Card(s) RTX 4080
Storage 2x HDD RAID 1, 3x M.2 NVMe
Display(s) 30" 2560x1600 + 19" 1280x1024
Software Windows 10 64-bit
True, if their objective is to train students how to program for *NIX clusters (which most research clusters are), this is a good, cheap alternative to everything else out there. A single, high-performance computer won't do a very job at that.

i would use virtual machines for that. should be fine for teaching. doesn't cover the hardware aspect though
 

FordGT90Concept

"I go fast!1!11!1!"
Joined
Oct 13, 2008
Messages
26,259 (4.65/day)
Location
IA, USA
System Name BY-2021
Processor AMD Ryzen 7 5800X (65w eco profile)
Motherboard MSI B550 Gaming Plus
Cooling Scythe Mugen (rev 5)
Memory 2 x Kingston HyperX DDR4-3200 32 GiB
Video Card(s) AMD Radeon RX 7900 XT
Storage Samsung 980 Pro, Seagate Exos X20 TB 7200 RPM
Display(s) Nixeus NX-EDG274K (3840x2160@144 DP) + Samsung SyncMaster 906BW (1440x900@60 HDMI-DVI)
Case Coolermaster HAF 932 w/ USB 3.0 5.25" bay + USB 3.2 (A+C) 3.5" bay
Audio Device(s) Realtek ALC1150, Micca OriGen+
Power Supply Enermax Platimax 850w
Mouse Nixeus REVEL-X
Keyboard Tesoro Excalibur
Software Windows 10 Home 64-bit
Benchmark Scores Faster than the tortoise; slower than the hare.
VM also wouldn't have network lag/limitations that makes cluster computing a challenge.
 

W1zzard

Administrator
Staff member
Joined
May 14, 2004
Messages
26,958 (3.71/day)
Processor Ryzen 7 5700X
Memory 48 GB
Video Card(s) RTX 4080
Storage 2x HDD RAID 1, 3x M.2 NVMe
Display(s) 30" 2560x1600 + 19" 1280x1024
Software Windows 10 64-bit
VM also wouldn't have network lag/limitations that makes cluster computing a challenge.

just use the linux traffic shaper to add latency.

if you get more than 0.5 ms with ping you should seriously start switching network equipment anyway as it will kill your performance
 
Joined
Mar 9, 2011
Messages
194 (0.04/day)
Location
Montreal, Canada
Processor Phenom II 955 @ 3955Mhz 1.45v
Motherboard ASUS M4A79XTD EVO
Cooling CoolerMaster Hyper TX3 push-pull /2x140mm + 2x230mm + 2x120mm = super noisy computer
Memory 4x2Gb Kingston DDR3-1333 8-8-8-22 @ 1527Mhz
Video Card(s) Crossfire 2x Sapphire Radeon 6850 @ 850/1200
Storage 320Gb Western Digital WD3200AAJS
Display(s) Samsung 23" 1920x1080
Case Azza Solano 1000R Full-Tower
Audio Device(s) VIA VT1708S (integrated) + quadraphonic speakers
Power Supply CoolerMaster Extreme Power Plus 700w
Software Windows 7 Ultimate 64bit
i didnt know that profesionals made lego racks
 
Top