1950X Goes full blown 128GB RAM!

xkm1948 · May 21, 2018

So the PI I have been working with tasked me to add more RAM to the Threadripper Genome Workstation we built back in February.

The RAM arrived today. So popped them right in and BAM works right off the bat. Gotta say Threadripper 128GB memory tuning felt a lot easier than my X99. With XMP they run at 2666 rated speed just fine for 1.2V. Bumping the voltage to 1.35V would allow me to run these Corsair LPX kits at 2933. However since what they do is pretty intolerant of ANY error we decided to run the RAM only at rated 2666.

While I was at it I replaced the stock NZXT X62 thermal paste with Kryonaut. Used TPU's own memory testing app for a quick 4 hours RAM stability test and everything runs just fine. Finally I had a bit fun OCing the 1950X, pushing it to 4.05GHz with 1.4V Vcore. Not too bad.

The workstation is already back to work assembling another genome. Gotta say the TR series is really awesome. Potentially we may be building several more TR based bioinformatics station once Threadripper 2 comes out later this year.

_UV_ · May 21, 2018

Maybe used real server from data center will be same price and performance and more reliable for scientific calculations? It will be louder, but... just my opinion.

xkm1948 · May 21, 2018

_UV_ said:
Maybe used real server from data center will be same price and performance and more reliable for scientific calculations? It will be louder, but... just my opinion.

It would be difficult to justify buying used equipment in Academia.

Passing used equipment between labs in the same department is fine. Buying used parts is not.

_UV_ · May 21, 2018

How about "academic prices" from HP or Dell, if they exist, probably not, but you may try next time.

xkm1948 · May 21, 2018

_UV_ said:
How about "academic prices" from HP or Dell, if they exist, probably not, but you may try next time.

Yeah no. For a 8 core server Dell wanna charge us $5000. Hell no.

We did all the homework, Threadripper is the best bang for the buck.

Caring1 · May 21, 2018

The +4 on your 24 pin power connector isn't pushed in all the way, it should be put in first or coupled correctly with the 20 pin when placed in.
Also EEC ram could be used in that board.

xkm1948 · May 22, 2018

Caring1 said:
The +4 on your 24 pin power connector isn't pushed in all the way, it should be put in first or coupled correctly with the 20 pin when placed in.
Also EEC ram could be used in that board.

Good eye. Just fixed it.

Boatvan · May 22, 2018

I assume you work in higher ed because we couldn't even dream of a system like this to play with on our poverty k12 budget :laugh:

Seriously though that's really cool. So it is for research purposes (you mentioned genome work)? I won't pry for details but I love seeing hardware of this caliber being used for a real project instead of just for enthusiast fun.

qubit · May 22, 2018

How much did that RAM cost you?! :eek:

Great machine and awesome use as a genome sequencer. That's for fighting genetic diseases, I take it?

xkm1948 · May 22, 2018

Caring1 said:
The +4 on your 24 pin power connector isn't pushed in all the way, it should be put in first or coupled correctly with the 20 pin when placed in.
Also EEC ram could be used in that board.

ECC unbuffered RAM costs quite a lot more. For now these will serve fine.

Boatvan said:
I assume you work in higher ed because we couldn't even dream of a system like this to play with on our poverty k12 budget
Seriously though that's really cool. So it is for research purposes (you mentioned genome work)? I won't pry for details but I love seeing hardware of this caliber being used for a real project instead of just for enthusiast fun.

Not prying at all! Check out this thread here. This workstation is used for sequencing and assembly of genome: bacteria, plants, animals and etc.

https://www.techpowerup.com/forums/threads/we-need-moar-cores-for-science.240729/

qubit said:
How much did that RAM cost you?!

Great machine and awesome use as a genome sequencer. That's for fighting genetic diseases, I take it?

lol I didn't pay for it so I don't know. I just installed the RAM and did some tweaking.
Yes. Studying of different organism's genome. Not just diseases though. It can be used for selective genetic engineering as well.

hat · May 23, 2018

@xkm1948 is studying genetic engineering. He also has a picture of a cat in his avatar, and in his signature. Genetic engineering is nothing to be taken lightly, and these facts lead me to assume either he is trying to become a cat, or he already is a cat now, altered by genetic engineering to at least (and maybe beyond) human levels of intelligence and ability. Or maybe he wishes to increase the power of other cats, thereby enabling them to take over the world?

er557 · May 23, 2018

xkm1948 said:
Yeah no. For a 8 core server Dell wanna charge us $5000. Hell no.

We did all the homework, Threadripper is the best bang for the buck.

Actually the best BANG FOR A BUCK are haswell-ep QS qualification stepping xeons, not any latest tier hardware. But those are hard to come by and not suitable for people not looking for used procs or non oem hardware. But having the turbo frequency of said xeons unlocked and tweaked, they have more productivity than current tier hardware, but again, it's not for everyone.

hat said:
@xkm1948 is studying genetic engineering. He also has a picture of a cat in his avatar, and in his signature. Genetic engineering is nothing to be taken lightly, and these facts lead me to assume either he is trying to become a cat, or he already is a cat now, altered by genetic engineering to at least (and maybe beyond) human levels of intelligence and ability. Or maybe he wishes to increase the power of other cats, thereby enabling them to take over the world?

AAnd you got a like from remixedcat, a mixed variety of android and feline

ChristTheGreat · May 23, 2018

Nice rig!

Too bad for dell charging you 5000$ for an 8 core server, we used to have a R730 with 2x E5-2690 V3 + 256gb of ram for around 20k (CAD).

But TR FTW!!!!

Bones · May 24, 2018

hat said:
@xkm1948 is studying genetic engineering. He also has a picture of a cat in his avatar, and in his signature. Genetic engineering is nothing to be taken lightly, and these facts lead me to assume either he is trying to become a cat, or he already is a cat now, altered by genetic engineering to at least (and maybe beyond) human levels of intelligence and ability. Or maybe he wishes to increase the power of other cats, thereby enabling them to take over the world?

Could be trying to do something anime-related with it...... I dunno. :wtf:

However with all that RAM he's set to do whatever is possible with it.

er557 · May 24, 2018

Usually after 64gb or so it's the ram speed and performance that matters more than it's capacity, and with a fast nvme drive can certainly afford spilling over some of it to page file, If the task is large enough

DeathtoGnomes · May 24, 2018

No RGB? So disappointing.

Caring1 · May 24, 2018

DeathtoGnomes said:
No RGB? So disappointing.

Those fans, and NZXT CPU cooler light up

HTC · May 24, 2018

er557 said:
Actually the best BANG FOR A BUCK are haswell-ep QS qualification stepping xeons, not any latest tier hardware. But those are hard to come by and not suitable for people not looking for used procs or non oem hardware. But having the turbo frequency of said xeons unlocked and tweaked, they have more productivity than current tier hardware, but again, it's not for everyone.

1st, let me just say i have zero idea about the prices for these types of CPUs.

With that disclaimer out of the way, let me tell you why i decided to reply to your post in this thread: meltdown / spectre.

Before these security issues were known, you may have been probably right but now it all depends on the type of workload, and i dunno what type of workload is OP's intended workload.

Meltdown is Intel only while spectre affects pretty much all manufacturers, which means even OP's rig can be affected severely by this.

R0H1T · May 24, 2018

er557 said:
Actually the best BANG FOR A BUCK are haswell-ep QS qualification stepping xeons, not any latest tier hardware. But those are hard to come by and not suitable for people not looking for used procs or non oem hardware. But having the turbo frequency of said xeons unlocked and tweaked, they have more productivity than current tier hardware, but again, it's not for everyone.

AAnd you got a like from remixedcat, a mixed variety of android and feline

I don't think QS chips are allowed in "critical" systems. Also TR has better IPC than Haswell & lower power consumption, can use more RAM as well IIRC.

PerfectWave · May 24, 2018

Fu ck so sexy!

er557 · May 24, 2018

QS chips are exactly oem chips, except they are not marked that way, once booted with microcode they are IDENTICAL in function and features to oem, except way cheaper.
About meltdown/spectre , iirc haswell-ep were not affected, but if they are affected, I installed the ms microcode update and the system is mitigated with ZERO performance penalty.
TR can use more ram? more than 768 GB of xeon? I don't think so. And how many pcie lanes does it have? dual xeons have 80 pcie 3 lanes. And with c states and c1e/speedstep in idle the xeons hardly use any power at all. What about ram bandwidth then? dual xeon have octal channel ddr4 @100gb/s speed, while TR has only quad

xkm1948 · May 24, 2018

No getting used/old system like Haswell-EP is impossible simply due to lack of warranty. All new equipment must have at least 2 years of manufacture warranty, hence why everything must be new components.

er557 · May 24, 2018

Of course, I figured as much, although haswell-ep xeons are still available today brand new, albeit cost an arm and a leg. I probably built my system saving 100K $.....

chaosmassive · May 24, 2018

3% utilization of memory?
it bizarre and surreal at same time

er557 · May 24, 2018

Yeah, 128gb a bit overkill if not on a busy web server

System Name	Virtual Reality / Bioinformatics
Processor	Undead CPU
Motherboard	Undead TUF X99
Cooling	Noctua NH-D15
Memory	GSkill 128GB DDR4-3000
Video Card(s)	EVGA RTX 3090 FTW3 Ultra
Storage	Samsung 960 Pro 1TB + 860 EVO 2TB + WD Black 5TB
Display(s)	32'' 4K Dell
Case	Fractal Design R5
Audio Device(s)	BOSE 2.0
Power Supply	Seasonic 850watt
Mouse	Logitech Master MX
Keyboard	Corsair K70 Cherry MX Blue
VR HMD	HTC Vive + Oculus Quest 2
Software	Windows 10 P

Processor	FX 8320 @4.2 \| i7 2600 @3.8 \| Xeon W3670 @ 3.6
Motherboard	Asus Sabertooth R2.0 \| Asus P8Z77-V Deluxe \| Gigabyte X58-UD7
Cooling	Zalman Performa 10+ \| Zalman Performa 11+ \| Zalman Performa 10+
Memory	Crucial Ballistix Sport XT 32GB @ 1866 \| Corsair Vengeance 32GB @1866 \| Samsung 24GB @ 1600
Video Card(s)	XFX Radeon 390x \| Zotac GTX 1070 AMP Extreme \| Zotac GTX 980 AMP Extreme
Storage	Intel SSD / SAS 15k Fujitsu \| Intel SSD / Velociraptors / Hitachi 2TB \| Intel SSD / Samsung 1TB
Display(s)	Samsung 245T \| HP ZR30w \| IBM 20" 4x3
Case	Chieftec \| Corsair Graphite 600T \| Thermaltake Xaser IV
Audio Device(s)	SB Titanium HD \| SB Titanium HD \| SB X-fi Elite Pro
Power Supply	Thermaltake 875W \| Corsair 850W \| Thermaltake 1500W
Mouse	Logitech \| Logitech \| Logitech
Keyboard	Mitsumi Classic \| Microsoft \|Microsoft
Software	W7 x64 \| W7 x64 \|W7 x64 / XP x32

System Name	Virtual Reality / Bioinformatics
Processor	Undead CPU
Motherboard	Undead TUF X99
Cooling	Noctua NH-D15
Memory	GSkill 128GB DDR4-3000
Video Card(s)	EVGA RTX 3090 FTW3 Ultra
Storage	Samsung 960 Pro 1TB + 860 EVO 2TB + WD Black 5TB
Display(s)	32'' 4K Dell
Case	Fractal Design R5
Audio Device(s)	BOSE 2.0
Power Supply	Seasonic 850watt
Mouse	Logitech Master MX
Keyboard	Corsair K70 Cherry MX Blue
VR HMD	HTC Vive + Oculus Quest 2
Software	Windows 10 P

Processor	FX 8320 @4.2 \| i7 2600 @3.8 \| Xeon W3670 @ 3.6
Motherboard	Asus Sabertooth R2.0 \| Asus P8Z77-V Deluxe \| Gigabyte X58-UD7
Cooling	Zalman Performa 10+ \| Zalman Performa 11+ \| Zalman Performa 10+
Memory	Crucial Ballistix Sport XT 32GB @ 1866 \| Corsair Vengeance 32GB @1866 \| Samsung 24GB @ 1600
Video Card(s)	XFX Radeon 390x \| Zotac GTX 1070 AMP Extreme \| Zotac GTX 980 AMP Extreme
Storage	Intel SSD / SAS 15k Fujitsu \| Intel SSD / Velociraptors / Hitachi 2TB \| Intel SSD / Samsung 1TB
Display(s)	Samsung 245T \| HP ZR30w \| IBM 20" 4x3
Case	Chieftec \| Corsair Graphite 600T \| Thermaltake Xaser IV
Audio Device(s)	SB Titanium HD \| SB Titanium HD \| SB X-fi Elite Pro
Power Supply	Thermaltake 875W \| Corsair 850W \| Thermaltake 1500W
Mouse	Logitech \| Logitech \| Logitech
Keyboard	Mitsumi Classic \| Microsoft \|Microsoft
Software	W7 x64 \| W7 x64 \|W7 x64 / XP x32

System Name	Virtual Reality / Bioinformatics
Processor	Undead CPU
Motherboard	Undead TUF X99
Cooling	Noctua NH-D15
Memory	GSkill 128GB DDR4-3000
Video Card(s)	EVGA RTX 3090 FTW3 Ultra
Storage	Samsung 960 Pro 1TB + 860 EVO 2TB + WD Black 5TB
Display(s)	32'' 4K Dell
Case	Fractal Design R5
Audio Device(s)	BOSE 2.0
Power Supply	Seasonic 850watt
Mouse	Logitech Master MX
Keyboard	Corsair K70 Cherry MX Blue
VR HMD	HTC Vive + Oculus Quest 2
Software	Windows 10 P

1950X Goes full blown 128GB RAM!

xkm1948

_UV_

xkm1948

_UV_

xkm1948

Caring1

xkm1948

Boatvan

qubit

Overclocked quantum bit

xkm1948

hat

Enthusiast

er557

ChristTheGreat

Bones

er557

DeathtoGnomes

Caring1

HTC

R0H1T

PerfectWave

er557

xkm1948

er557

chaosmassive

er557

System Name	Black Box
Processor	Intel Xeon E3-1260L v5
Motherboard	MSI E3 KRAIT Gaming v5
Cooling	Tt tower + 120mm Tt fan
Memory	G.Skill 16GB 3600 C18
Video Card(s)	Asus GTX 970 Mini
Storage	Kingston A2000 512Gb NVME
Display(s)	AOC 24" Freesync 1m.s. 75Hz
Case	Corsair 450D High Air Flow.
Audio Device(s)	No need.
Power Supply	FSP Aurum 650W
Mouse	Yes
Keyboard	Of course
Software	W10 Pro 64 bit

System Name	Quantumville™
Processor	Intel Core i7-2700K @ 4GHz
Motherboard	Asus P8Z68-V PRO/GEN3
Cooling	Noctua NH-D14
Memory	16GB (2 x 8GB Corsair Vengeance Black DDR3 PC3-12800 C9 1600MHz)
Video Card(s)	MSI RTX 2080 SUPER Gaming X Trio
Storage	Samsung 850 Pro 256GB \| WD Black 4TB \| WD Blue 6TB
Display(s)	ASUS ROG Strix XG27UQR (4K, 144Hz, G-SYNC compatible) \| Asus MG28UQ (4K, 60Hz, FreeSync compatible)
Case	Cooler Master HAF 922
Audio Device(s)	Creative Sound Blaster X-Fi Fatal1ty PCIe
Power Supply	Corsair AX1600i
Mouse	Microsoft Intellimouse Pro - Black Shadow
Keyboard	Yes
Software	Windows 10 Pro 64-bit

System Name	Starlifter :: Dragonfly
Processor	i7 2600k 4.4GHz :: i5 10400
Motherboard	ASUS P8P67 Pro :: ASUS Prime H570-Plus
Cooling	Cryorig M9 :: Stock
Memory	4x4GB DDR3 2133 :: 2x8GB DDR4 2400
Video Card(s)	PNY GTX1070 :: Integrated UHD 630
Storage	Crucial MX500 1TB, 2x1TB Seagate RAID 0 :: Mushkin Enhanced 60GB SSD, 3x4TB Seagate HDD RAID5
Display(s)	Onn 165hz 1080p :: Acer 1080p
Case	Antec SOHO 1030B :: Old White Full Tower
Audio Device(s)	Creative X-Fi Titanium Fatal1ty Pro - Bose Companion 2 Series III :: None
Power Supply	FSP Hydro GE 550w :: EVGA Supernova 550
Software	Windows 10 Pro - Plex Server on Dragonfly
Benchmark Scores	>9000

System Name	future xeon II
Processor	DUAL SOCKET xeon e5 2686 v3 , 36c/72t, hacked all cores @3.5ghz, TDP limit hacked
Motherboard	asrock rack ep2c612 ws
Cooling	case fans,liquid corsair h100iv2 x2
Memory	96 gb ddr4 2133mhz gskill+corsair
Video Card(s)	2x 1080 sc acx3 SLI, @STOCK
Storage	Hp ex950 2tb nvme+ adata xpg sx8200 pro 1tb nvme+ sata ssd's+ spinners
Display(s)	philips 40" bdm4065uc 4k @60
Case	silverstone temjin tj07-b
Audio Device(s)	sb Z
Power Supply	corsair hx1200i
Mouse	corsair m95 16 buttons
Keyboard	microsoft internet keyboard pro
Software	windows 10 x64 1903 ,enterprise
Benchmark Scores	fire strike ultra- 10k time spy- 15k cpu z- 400/15000

System Name	CTG Computer
Processor	AMD Ryzen 5 7600
Motherboard	Asrock B650M PRO RS WIFI
Cooling	Thermalright PA120 SE
Memory	2x 16gb G.SKILL F5-6000J3038F16GX2-FX5
Video Card(s)	Gigabyte RX6800XT Gaming OC
Storage	WD Black SN850X 2TB
Display(s)	MAG274QRF-QD \| Asus vg248qe
Case	SAMA IM01
Audio Device(s)	Creative SoundBlasterx G6
Power Supply	Corsair SF750
Mouse	Logitech G pro Wireless
Keyboard	Corsair Strafe RGB MK2
Software	Windows 11 Pro x64

Processor	Ryzen 2700X
Motherboard	X470 Tachi Ultimate
Cooling	Scythe Big Shuriken 3
Memory	C.R.S.
Video Card(s)	Radeon VII
Software	Win 7
Benchmark Scores	Never high enough

System Name	Dumbass
Processor	AMD Ryzen 7800X3D
Motherboard	ASUS TUF gaming B650
Cooling	Artic Liquid Freezer 2 - 420mm
Memory	G.Skill Sniper 32gb DDR5 6000
Video Card(s)	GreenTeam 4070 ti super 16gb
Storage	Samsung EVO 500gb & 1Tb, 2tb HDD, 500gb WD Black
Display(s)	1x Nixeus NX_EDG27, 2x Dell S2440L (16:9)
Case	Phanteks Enthoo Primo w/8 140mm SP Fans
Audio Device(s)	onboard (realtek?) - SPKRS:Logitech Z623 200w 2.1
Power Supply	Corsair HX1000i
Mouse	Steeseries Esports Wireless
Keyboard	Corsair K100
Software	windows 10 H
Benchmark Scores	https://i.imgur.com/aoz3vWY.jpg?2

System Name	HTC's System
Processor	Ryzen 5 2600X
Motherboard	Asrock Taichi X370
Cooling	NH-C14, with the AM4 mounting kit
Memory	G.Skill Kit 16GB DDR4 F4 - 3200 C16D - 16 GTZB
Video Card(s)	Sapphire Nitro+ Radeon RX 480 OC 4 GB
Storage	1 Samsung NVMe 960 EVO 250 GB + 1 3.5" Seagate IronWolf Pro 6TB 7200RPM 256MB SATA III
Display(s)	LG 27UD58
Case	Fractal Design Define R6 USB-C
Audio Device(s)	Onboard
Power Supply	Corsair TX 850M 80+ Gold
Mouse	Razer Deathadder Elite
Software	Ubuntu 19.04 LTS

System Name	Gaming PC / I7 XEON
Processor	I7 4790K @stock / XEON W3680 @ stock
Motherboard	Asus Z97 MAXIMUS VII FORMULA / GIGABYTE X58 UD7
Cooling	X61 Kraken / X61 Kraken
Memory	32gb Vengeance 2133 Mhz / 24b Corsair XMS3 1600 Mhz
Video Card(s)	Gainward GLH 1080 / MSI Gaming X Radeon RX480 8 GB
Storage	Samsung EVO 850 500gb ,3 tb seagate, 2 samsung 1tb in raid 0 / Kingdian 240 gb, megaraid SAS 9341-8
Display(s)	2 BENQ 27" GL2706PQ / Dell UP2716D LCD Monitor 27 "
Case	Corsair Graphite Series 780T / Corsair Obsidian 750 D
Audio Device(s)	ON BOARD / ON BOARD
Power Supply	Sapphire Pure 950w / Corsair RMI 750w
Mouse	Steelseries Sesnsei / Steelseries Sensei raw
Keyboard	Razer BlackWidow Chroma / Razer BlackWidow Chroma
Software	Windows 1064bit PRO / Windows 1064bit PRO

System Name	Scrapped Parts, Unite !
Processor	Ryzen 5 3600 @4.0 Ghz
Motherboard	MSI B450-A Pro MAX
Cooling	Stock
Memory	Team Group Elite 16 GB 3133Mhz
Video Card(s)	Colorful iGame GeForce GTX1060 Vulcan U 6G
Storage	Hitachi 500 GB, Sony 1TB, KINGSTON 400A 120GB // Samsung 160 GB
Display(s)	HP 2009f
Case	Xigmatek Asgard Pro // Cooler Master Centurion 5
Power Supply	OCZ ModXStream Pro 500 W
Mouse	Logitech G102
Software	Windows 10 x64
Benchmark Scores	Minesweeper 30fps, Tetris 40 fps, with overheated CPU and GPU