2.5gbe Network speeds all over the place ...

[neko77025]

So, Upgraded to 2.5gbe. for moving files from my PC to my server. (got A Netgear GS110EMX cheap on ebay)

PC hardware
Ryzen 5900x
Gigabyte Master x570
(realtek 2.5GbE onboard)
SAMSUNG 980 PRO 2tb
Win 10
RTX 3070 ti

Server hardware
i10 10900
ASUS Prime Z590M-PLUS
(realtek 2.5GbE PCIe 1x card)
WD SN750 2TB
Win10
P400

Network
Netgear GS110EMX
Cat 6a

So both Computer show the network
Link speed (Receive/Transmit): 2500/2500 (Mbps)
Switch shows the same. So all is set up right.
All Drivers & frimware are up to date.

The issues is when I copy A files the Speeds go up and down .. Ranges 280 MB/s - 70 MB/s .. However I would say and avg of 210 MB/s. So an improvement over my 1GbE. Before , when just using 1GbE my speeds were always capped at 111/MBs ... but it was solid the whole time no up/down ever. (this is for large 15gb - 50gb files)

So my thoughts are , One or Both of the NICs are thermal throttling or it A realtek issue.

Is this normal , is this yalls experience ? Will intel 2.5 nics do better ? How about USB 2.5gb Nic
(Sever dont have no room for a 10gbe card)

 

[Solaris17]

I mean an avg of 210mB/s IS 2.1Gb/s so you are well within overhead and transfer rate

 

[ir_cow]

I mean an avg of 210mB/s IS 2.1Gb/s so you are well within overhead and transfer rate

Yep converting bits and bytes can get you.

 

[R-T-B]

Yep converting bits and bytes can get you.

Got bit by the darn bytes.

 

[neko77025]

So .. figured out what was going on. Had to do with Hyper V Virtual Nic. Was just bad timing when this all happen. My printers WIFI went out , had to run A Rj45 to it , but had to swap out A switch near my PC. When I did that , i changed My VM switch around , was also when I working with 2.5gbe NICs .. when I first ran them they were giving me 2.5 .. but some point I did VMnic Passthrew with them and that killed off Perfromance .. was EPIC confused.. Got another 2.5Nic and same thing kind of happen again. (Did not know making A VM nic, would cap host speed to 1gbe)... Was epic confused. Happen to grab 2x cheap 10gbe NICs on ebay. Was messing with them and noticed I would get better speeds DLing vs UPing from server. (also at this point had bought some cat 7 cables , just to for testing to skip what i put in the walls 8 years ago) ...

Anyhow .. removed VMnic .. and BAM getting the right speeds.
(BTW did not matter if VMs were on or off , just being in system not in used , capped host to 1gbe)

Moved my VMs to use Wifi passthrew for now. Need another 10gbe switch grrr

 

[DudeBeFishing]

TLDR; Put Hyper-V virtual switch on a separate NIC from the OS.

I had the same issue with Hyper-V in Windows 2008 R2. Was using a 10gb NIC, but only got about 5gbps in one direction, 10gbps in the other. I thought my fiber transceiver was dying. I deleted the Hyper-V virtual switch, and transfer speeds went back to 10gbps both directions.

Another issue I had was VMs losing connectivity randomly. There was an issue with Broadcom NICs using older driver versions and the Hyper-V switch. I think it was drivers older than 17.xxx, before QLogic bought them out.

 

[Harlow]

Thanks for the tip about putting Hyper-V switch on another NIC from the OS. I sometimes experience dropouts on my 10GbE RJ45 NICs connected to an old 10G Netgear switch upstairs, but my SFP+ fibre NICs work fine on the new 10G Microtik switch downstairs. Of course it could be something else entirely (probably the Netgear firmware) but it's worth trying.

 

[Aquinus]

(Did not know making A VM nic, would cap host speed to 1gbe)

The network bridge is probably limited to 1Gbps not to mention the CPU overhead of handling that. If you want full speed from an ethernet adapter in a VM, I suggest using IOMMU/VT-d to pass thru the physical adapter to the VM. Mind you that the VM will have full control over the device when you do this and the host will not. This is usually the go-to solution to have on-metal performance in a VM.