• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

internal network speed!

freaksavior

To infinity ... and beyond!
Joined
Dec 11, 2006
Messages
8,095 (1.28/day)
System Name ZeroUptime | M.A.S.S / MM1
Processor Xeon 2659 v3 / Xeon 2683 v4 / ARM A14
Motherboard Asus X99-E-10G WS / ASRock x99 usb 3.1 / Apple
Cooling NZXT Kraken / Noctua NH-L12 / Apple
Memory 16Gb DDR4 / 32Gb DDR4 / 16GB HBLM
Video Card(s) Powercooler ATI vega 64 / GT 7300 / ARM
Storage Samsung 970 512 Evo NVMe / A lot. / 256 + 512 External TB3
Display(s) Acer Predator X34 / Headless / Acer X34 Non predator
Case NZXT H630 |Rosewill 8bay 4u server chasiss / MMM1
Audio Device(s) Onboard / Onboard / Onboard
Power Supply Corais HX850 | Corsair TX750 / Internal 250w
Mouse g502 proteus core / Headless / g502 proteus core
Keyboard Corsair K95 Cherry Blue / Headless / K65 Cherry Red
Software Windows 10 / ESXI / Big Sur 11.2.2
What is your INTERNAL network speed between machines?

Both of my servers are using gigabit nics, one is a pci card, the other is onboard. I understand it has some what to do with overall system performance, but right now I am getting 15.4 which is just slightly faster than the onboard 100mbps nic I had.

I theoretic speed is 125mb's and I would love to see that, but why the heck am I getting a 10th of that?
 

Easy Rhino

Linux Advocate
Staff member
Joined
Nov 13, 2006
Messages
15,436 (2.43/day)
Location
Mid-Atlantic
System Name Desktop
Processor i5 13600KF
Motherboard AsRock B760M Steel Legend Wifi
Cooling Noctua NH-U9S
Memory 4x 16 Gb Gskill S5 DDR5 @6000
Video Card(s) Gigabyte Gaming OC 6750 XT 12GB
Storage WD_BLACK 4TB SN850x
Display(s) Gigabye M32U
Case Corsair Carbide 400C
Audio Device(s) On Board
Power Supply EVGA Supernova 650 P2
Mouse MX Master 3s
Keyboard Logitech G915 Wireless Clicky
Software The Matrix
typical speeds for 1 drive sata setups across a network. which is why it is hilarious that all of the NAS manufacturers market their 1gig network ports when you will never ever get close to that ever.
 
Joined
Sep 13, 2008
Messages
1,230 (0.22/day)
Location
Metro Atlanta
Processor AMD Ryzen 1700
Motherboard Gigabyte AB350 GAMING 3
Memory 16GB (2x8) 3200MHz
Display(s) Acer 24" LCD
Software Windows 10 Pro
typical speeds for 1 drive sata setups across a network. which is why it is hilarious that all of the NAS manufacturers market their 1gig network ports when you will never ever get close to that ever.

That's exactly it. Stupid hard drives!
 
Joined
Mar 6, 2008
Messages
2,753 (0.47/day)
Location
Minnesota
I get capped at 115MB/s PC to PC with ATTO. Why are NAS systems so slow?
 
Joined
Sep 1, 2009
Messages
1,180 (0.22/day)
Location
CO
System Name 4k
Processor AMD 5800x3D
Motherboard MSI MAG b550m Mortar Wifi
Cooling Corsair H100i
Memory 4x8Gb Crucial Ballistix 3600 CL16 bl8g36c16u4b.m8fe1
Video Card(s) Nvidia Reference 3080Ti
Storage ADATA XPG SX8200 Pro 1TB
Display(s) LG 48" C1
Case CORSAIR Carbide AIR 240 Micro-ATX
Audio Device(s) Asus Xonar STX
Power Supply EVGA SuperNOVA 650W
Software Microsoft Windows10 Pro x64
I get capped at 115MB/s PC to PC with ATTO. Why are NAS systems so slow?

Are you using a switch? Home switches cant hit that speed sustained.
 
Joined
Sep 13, 2008
Messages
1,230 (0.22/day)
Location
Metro Atlanta
Processor AMD Ryzen 1700
Motherboard Gigabyte AB350 GAMING 3
Memory 16GB (2x8) 3200MHz
Display(s) Acer 24" LCD
Software Windows 10 Pro
It's direct, one of the benefits of dual NICs.

I am not sure about the other machine, but you have to consider you have an SSD in your PC.
 
Joined
Sep 1, 2009
Messages
1,180 (0.22/day)
Location
CO
System Name 4k
Processor AMD 5800x3D
Motherboard MSI MAG b550m Mortar Wifi
Cooling Corsair H100i
Memory 4x8Gb Crucial Ballistix 3600 CL16 bl8g36c16u4b.m8fe1
Video Card(s) Nvidia Reference 3080Ti
Storage ADATA XPG SX8200 Pro 1TB
Display(s) LG 48" C1
Case CORSAIR Carbide AIR 240 Micro-ATX
Audio Device(s) Asus Xonar STX
Power Supply EVGA SuperNOVA 650W
Software Microsoft Windows10 Pro x64
It's direct, one of the benefits of dual NICs.

Yes that's his problem. For him to get decent speed he would need an enterprise switch with the throughput he needs. Then he would probably have to partition the server disks, on the outside of the platter to simulate short stroking to get the wanted speeds all the time.
 
Joined
Mar 6, 2008
Messages
2,753 (0.47/day)
Location
Minnesota
I am not sure about the other machine, but you have to consider you have an SSD in your PC.

I tried with a RAMdrive, SSD, 2x 500GB RAID 0, and a nearly full 500GB (16GB left at the very end of the drive). Even the nearly full drive got me 85MB/s. The RAID array got 115 write but only ~85 read.
 
Joined
Jun 23, 2011
Messages
389 (0.08/day)
System Name potato
Processor Ryzen 9 3950X
Motherboard MSI MAG B550 Tomahawk
Cooling Custom WC Loop
Memory 2x16GB G.Skill Trident Z Neo 3600
Video Card(s) Radeon VII
Storage SSD: Team 512GB NVMe + Team 2TB SATA || HDD: 2x WD VRaptor 500GB & 2x WD Blue 4TB
Display(s) XIAOMI Curved 34" 144Hz UWQHD
Case be quiet dark base pro 900
Audio Device(s) Edifier R1800T, Logitech G733
Power Supply Corsair AX860i
Mouse Logitech G Pro
Keyboard Corsair K65
Software win 10 amd64
What is your INTERNAL network speed between machines?

Both of my servers are using gigabit nics, one is a pci card, the other is onboard. I understand it has some what to do with overall system performance, but right now I am getting 15.4 which is just slightly faster than the onboard 100mbps nic I had.

I theoretic speed is 125mb's and I would love to see that, but why the heck am I getting a 10th of that?
yeah, that kinda low

what kind of server is that? what lan cables you are running them in? how long the cable runs?

for typical file server/proxy server it usually peaks at 40-ishMBps (non raid) and 70-ishMBps (raid) and tops at around 100MBps (fast pciex SSD) - with good gigabit switches and cables
 

Solaris17

Super Dainty Moderator
Staff member
Joined
Aug 16, 2005
Messages
25,772 (3.79/day)
Location
Alabama
System Name Rocinante
Processor I9 14900KS
Motherboard EVGA z690 Dark KINGPIN (modded BIOS)
Cooling EK-AIO Elite 360 D-RGB
Memory 64GB Gskill Trident Z5 DDR5 6000 @6400
Video Card(s) MSI SUPRIM Liquid X 4090
Storage 1x 500GB 980 Pro | 1x 1TB 980 Pro | 1x 8TB Corsair MP400
Display(s) Odyssey OLED G9 G95SC
Case Lian Li o11 Evo Dynamic White
Audio Device(s) Moondrop S8's on Schiit Hel 2e
Power Supply Bequiet! Power Pro 12 1500w
Mouse Lamzu Atlantis mini (White)
Keyboard Monsgeek M3 Lavender, Akko Crystal Blues
VR HMD Quest 3
Software Windows 11
Benchmark Scores I dont have time for that.
because your not running SSDs or raided cheetahs.
 
Joined
Jun 23, 2011
Messages
389 (0.08/day)
System Name potato
Processor Ryzen 9 3950X
Motherboard MSI MAG B550 Tomahawk
Cooling Custom WC Loop
Memory 2x16GB G.Skill Trident Z Neo 3600
Video Card(s) Radeon VII
Storage SSD: Team 512GB NVMe + Team 2TB SATA || HDD: 2x WD VRaptor 500GB & 2x WD Blue 4TB
Display(s) XIAOMI Curved 34" 144Hz UWQHD
Case be quiet dark base pro 900
Audio Device(s) Edifier R1800T, Logitech G733
Power Supply Corsair AX860i
Mouse Logitech G Pro
Keyboard Corsair K65
Software win 10 amd64
It's direct, one of the benefits of dual NICs.

have you tested teaming/bonding on them? and if you have, how much bandwidth you could squeeze from them?
just curious ;)
 
Joined
Mar 6, 2008
Messages
2,753 (0.47/day)
Location
Minnesota
have you tested teaming/bonding on them? and if you have, how much bandwidth you could squeeze from them?
just curious ;)

If I remember and if I can figure out how to do it, I will try that out tomorrow.
 

freaksavior

To infinity ... and beyond!
Joined
Dec 11, 2006
Messages
8,095 (1.28/day)
System Name ZeroUptime | M.A.S.S / MM1
Processor Xeon 2659 v3 / Xeon 2683 v4 / ARM A14
Motherboard Asus X99-E-10G WS / ASRock x99 usb 3.1 / Apple
Cooling NZXT Kraken / Noctua NH-L12 / Apple
Memory 16Gb DDR4 / 32Gb DDR4 / 16GB HBLM
Video Card(s) Powercooler ATI vega 64 / GT 7300 / ARM
Storage Samsung 970 512 Evo NVMe / A lot. / 256 + 512 External TB3
Display(s) Acer Predator X34 / Headless / Acer X34 Non predator
Case NZXT H630 |Rosewill 8bay 4u server chasiss / MMM1
Audio Device(s) Onboard / Onboard / Onboard
Power Supply Corais HX850 | Corsair TX750 / Internal 250w
Mouse g502 proteus core / Headless / g502 proteus core
Keyboard Corsair K95 Cherry Blue / Headless / K65 Cherry Red
Software Windows 10 / ESXI / Big Sur 11.2.2
Cables are cat5e and cables are ran through the house. I have had in the upwards of 60+ sustained speeds on a single drive write over the gigiabit lan but it's not working between the two machines.

I am thinking it's to much overhead between date flying across my network between all the devices on it. I have probably around 20 devices in total wired and wireless using the network at the same time.

I was mostly curious what others got but my question ended up turning into how can I make it faster :p
 

Solaris17

Super Dainty Moderator
Staff member
Joined
Aug 16, 2005
Messages
25,772 (3.79/day)
Location
Alabama
System Name Rocinante
Processor I9 14900KS
Motherboard EVGA z690 Dark KINGPIN (modded BIOS)
Cooling EK-AIO Elite 360 D-RGB
Memory 64GB Gskill Trident Z5 DDR5 6000 @6400
Video Card(s) MSI SUPRIM Liquid X 4090
Storage 1x 500GB 980 Pro | 1x 1TB 980 Pro | 1x 8TB Corsair MP400
Display(s) Odyssey OLED G9 G95SC
Case Lian Li o11 Evo Dynamic White
Audio Device(s) Moondrop S8's on Schiit Hel 2e
Power Supply Bequiet! Power Pro 12 1500w
Mouse Lamzu Atlantis mini (White)
Keyboard Monsgeek M3 Lavender, Akko Crystal Blues
VR HMD Quest 3
Software Windows 11
Benchmark Scores I dont have time for that.
Cables are cat5e and cables are ran through the house. I have had in the upwards of 60+ sustained speeds on a single drive write over the gigiabit lan but it's not working between the two machines.

I am thinking it's to much overhead between date flying across my network between all the devices on it. I have probably around 20 devices in total wired and wireless using the network at the same time.

I was mostly curious what others got but my question ended up turning into how can I make it faster :p

nothing new their. Id say welcome to TPU but me and you already learned these ropes.
 
Joined
Jun 23, 2011
Messages
389 (0.08/day)
System Name potato
Processor Ryzen 9 3950X
Motherboard MSI MAG B550 Tomahawk
Cooling Custom WC Loop
Memory 2x16GB G.Skill Trident Z Neo 3600
Video Card(s) Radeon VII
Storage SSD: Team 512GB NVMe + Team 2TB SATA || HDD: 2x WD VRaptor 500GB & 2x WD Blue 4TB
Display(s) XIAOMI Curved 34" 144Hz UWQHD
Case be quiet dark base pro 900
Audio Device(s) Edifier R1800T, Logitech G733
Power Supply Corsair AX860i
Mouse Logitech G Pro
Keyboard Corsair K65
Software win 10 amd64
If I remember and if I can figure out how to do it, I will try that out tomorrow.
thanks, looking forward for the result ;)

Cables are cat5e and cables are ran through the house. I have had in the upwards of 60+ sustained speeds on a single drive write over the gigiabit lan but it's not working between the two machines.

I am thinking it's to much overhead between date flying across my network between all the devices on it. I have probably around 20 devices in total wired and wireless using the network at the same time.

I was mostly curious what others got but my question ended up turning into how can I make it faster :p
you could plug out other devices from the network and test the bandwidth between the servers,
and if the bandwidth does not improve, try new ethernet cables, just to make sure it's not the cable that degrading. you might also want to check the ethernet switch, or simply switch to other port(s)
 

freaksavior

To infinity ... and beyond!
Joined
Dec 11, 2006
Messages
8,095 (1.28/day)
System Name ZeroUptime | M.A.S.S / MM1
Processor Xeon 2659 v3 / Xeon 2683 v4 / ARM A14
Motherboard Asus X99-E-10G WS / ASRock x99 usb 3.1 / Apple
Cooling NZXT Kraken / Noctua NH-L12 / Apple
Memory 16Gb DDR4 / 32Gb DDR4 / 16GB HBLM
Video Card(s) Powercooler ATI vega 64 / GT 7300 / ARM
Storage Samsung 970 512 Evo NVMe / A lot. / 256 + 512 External TB3
Display(s) Acer Predator X34 / Headless / Acer X34 Non predator
Case NZXT H630 |Rosewill 8bay 4u server chasiss / MMM1
Audio Device(s) Onboard / Onboard / Onboard
Power Supply Corais HX850 | Corsair TX750 / Internal 250w
Mouse g502 proteus core / Headless / g502 proteus core
Keyboard Corsair K95 Cherry Blue / Headless / K65 Cherry Red
Software Windows 10 / ESXI / Big Sur 11.2.2
nothing new their. Id say welcome to TPU but me and you already learned these ropes.

heh yeah, I know the ropes :)

thanks, looking forward for the result ;)


you could plug out other devices from the network and test the bandwidth between the servers,
and if the bandwidth does not improve, try new Ethernet cables, just to make sure it's not the cable that degrading. you might also want to check the Ethernet switch, or simply switch to other port(s)

Going to try it out tomorrow actually, straight plug in to the server from the server
 

freaksavior

To infinity ... and beyond!
Joined
Dec 11, 2006
Messages
8,095 (1.28/day)
System Name ZeroUptime | M.A.S.S / MM1
Processor Xeon 2659 v3 / Xeon 2683 v4 / ARM A14
Motherboard Asus X99-E-10G WS / ASRock x99 usb 3.1 / Apple
Cooling NZXT Kraken / Noctua NH-L12 / Apple
Memory 16Gb DDR4 / 32Gb DDR4 / 16GB HBLM
Video Card(s) Powercooler ATI vega 64 / GT 7300 / ARM
Storage Samsung 970 512 Evo NVMe / A lot. / 256 + 512 External TB3
Display(s) Acer Predator X34 / Headless / Acer X34 Non predator
Case NZXT H630 |Rosewill 8bay 4u server chasiss / MMM1
Audio Device(s) Onboard / Onboard / Onboard
Power Supply Corais HX850 | Corsair TX750 / Internal 250w
Mouse g502 proteus core / Headless / g502 proteus core
Keyboard Corsair K95 Cherry Blue / Headless / K65 Cherry Red
Software Windows 10 / ESXI / Big Sur 11.2.2
Server to BackupServer



Server to server local



BackupServer to BackupServer
 
Last edited:
Joined
Jun 23, 2011
Messages
389 (0.08/day)
System Name potato
Processor Ryzen 9 3950X
Motherboard MSI MAG B550 Tomahawk
Cooling Custom WC Loop
Memory 2x16GB G.Skill Trident Z Neo 3600
Video Card(s) Radeon VII
Storage SSD: Team 512GB NVMe + Team 2TB SATA || HDD: 2x WD VRaptor 500GB & 2x WD Blue 4TB
Display(s) XIAOMI Curved 34" 144Hz UWQHD
Case be quiet dark base pro 900
Audio Device(s) Edifier R1800T, Logitech G733
Power Supply Corsair AX860i
Mouse Logitech G Pro
Keyboard Corsair K65
Software win 10 amd64
have you check the link state, just to make sure it is running on gigabit mode. also you might want to test it with new, shorter lan cable, and/or test it with pcie gigabit ethernet add in board if you happen to have one lying around :)
 

freaksavior

To infinity ... and beyond!
Joined
Dec 11, 2006
Messages
8,095 (1.28/day)
System Name ZeroUptime | M.A.S.S / MM1
Processor Xeon 2659 v3 / Xeon 2683 v4 / ARM A14
Motherboard Asus X99-E-10G WS / ASRock x99 usb 3.1 / Apple
Cooling NZXT Kraken / Noctua NH-L12 / Apple
Memory 16Gb DDR4 / 32Gb DDR4 / 16GB HBLM
Video Card(s) Powercooler ATI vega 64 / GT 7300 / ARM
Storage Samsung 970 512 Evo NVMe / A lot. / 256 + 512 External TB3
Display(s) Acer Predator X34 / Headless / Acer X34 Non predator
Case NZXT H630 |Rosewill 8bay 4u server chasiss / MMM1
Audio Device(s) Onboard / Onboard / Onboard
Power Supply Corais HX850 | Corsair TX750 / Internal 250w
Mouse g502 proteus core / Headless / g502 proteus core
Keyboard Corsair K95 Cherry Blue / Headless / K65 Cherry Red
Software Windows 10 / ESXI / Big Sur 11.2.2
Yeah they are all set to run 1000Mbps full duplex. Shorter cables are not an option, it's wired through my house.

Tomorrow (later today) I am going to put them together and do a crossover. Hope that narrors the shit down.
 

Easy Rhino

Linux Advocate
Staff member
Joined
Nov 13, 2006
Messages
15,436 (2.43/day)
Location
Mid-Atlantic
System Name Desktop
Processor i5 13600KF
Motherboard AsRock B760M Steel Legend Wifi
Cooling Noctua NH-U9S
Memory 4x 16 Gb Gskill S5 DDR5 @6000
Video Card(s) Gigabyte Gaming OC 6750 XT 12GB
Storage WD_BLACK 4TB SN850x
Display(s) Gigabye M32U
Case Corsair Carbide 400C
Audio Device(s) On Board
Power Supply EVGA Supernova 650 P2
Mouse MX Master 3s
Keyboard Logitech G915 Wireless Clicky
Software The Matrix
just typical speeds man. nothing to worry about.
 
Joined
Mar 6, 2008
Messages
2,753 (0.47/day)
Location
Minnesota
I set up teaming on both system, it showed 2Gb but it would absolutely not get above gigabit during the transfer. I set all types of teaming modes too.


I really didn't mean to sidetrack this thread but umm yeah...
 
Joined
Jan 17, 2010
Messages
12,280 (2.37/day)
Location
Oregon
System Name Juliette // HTPC
Processor Intel i7 9700K // AMD Ryzen 5 5600G
Motherboard ASUS Prime Z390X-A // ASRock B550 ITX-AC
Cooling Noctua NH-U12 Black // Stock
Memory Corsair DDR4 3600 32gb //G.SKILL Trident Z Royal Series 16GB (2 x 8GB) 3600
Video Card(s) ASUS RTX4070 OC// GTX 1650
Storage Samsung 970 EVO NVMe 1Tb, Intel 665p Series M.2 2280 1TB // Samsung 1Tb SSD
Display(s) ASUS VP348QGL 34" Quad HD 3440 x 1440 // 55" LG 4K SK8000 Series
Case Seasonic SYNCRO Q7// Silverstone Granada GD05
Audio Device(s) Focusrite Scarlett 4i4 // HDMI to Samsung HW-R650 sound bar
Power Supply Seasonic SYNCRO 750 W // CORSAIR Vengeance 650M
Mouse Cooler Master MM710 53G
Keyboard Logitech 920-009300 G512 SE
Software Windows 10 Pro // Windows 10 Pro
I just bought a Linksys E4200 so I tested the speed from my Desktop to my HTPC plater to plater. A 10.5 Gb movie took 86 seconds at 142 Mbs is the reported speed.
 

Aquinus

Resident Wat-man
Joined
Jan 28, 2012
Messages
13,147 (2.96/day)
Location
Concord, NH, USA
System Name Apollo
Processor Intel Core i9 9880H
Motherboard Some proprietary Apple thing.
Memory 64GB DDR4-2667
Video Card(s) AMD Radeon Pro 5600M, 8GB HBM2
Storage 1TB Apple NVMe, 4TB External
Display(s) Laptop @ 3072x1920 + 2x LG 5k Ultrafine TB3 displays
Case MacBook Pro (16", 2019)
Audio Device(s) AirPods Pro, Sennheiser HD 380s w/ FIIO Alpen 2, or Logitech 2.1 Speakers
Power Supply 96w Power Adapter
Mouse Logitech MX Master 3
Keyboard Logitech G915, GL Clicky
Software MacOS 12.1
For everyone using gigabite, I hope you're using CAT6 cables if you really want full gigabit speeds, CAT5 will do gigabit and usually is fine with short distances, but for longer stretches your performance could degrade quickly. You may want to test using a ram disk and to make sure that caching is disabled. Windows loves to cache. :banghead:
 

freaksavior

To infinity ... and beyond!
Joined
Dec 11, 2006
Messages
8,095 (1.28/day)
System Name ZeroUptime | M.A.S.S / MM1
Processor Xeon 2659 v3 / Xeon 2683 v4 / ARM A14
Motherboard Asus X99-E-10G WS / ASRock x99 usb 3.1 / Apple
Cooling NZXT Kraken / Noctua NH-L12 / Apple
Memory 16Gb DDR4 / 32Gb DDR4 / 16GB HBLM
Video Card(s) Powercooler ATI vega 64 / GT 7300 / ARM
Storage Samsung 970 512 Evo NVMe / A lot. / 256 + 512 External TB3
Display(s) Acer Predator X34 / Headless / Acer X34 Non predator
Case NZXT H630 |Rosewill 8bay 4u server chasiss / MMM1
Audio Device(s) Onboard / Onboard / Onboard
Power Supply Corais HX850 | Corsair TX750 / Internal 250w
Mouse g502 proteus core / Headless / g502 proteus core
Keyboard Corsair K95 Cherry Blue / Headless / K65 Cherry Red
Software Windows 10 / ESXI / Big Sur 11.2.2
just typical speeds man. nothing to worry about.

Yeah I can see that now since I was able to get a sustained 40+ directly connected. I still think it should be faster but 40Mbps is fine by me right now.
 
Top