TCP BBR has been enabled on TPU's servers. Feedback?

W1zzard · Apr 9, 2023

Huge improve network performance by change TCP congestion control to BBR

BBR improve Linux server response time. Huge improve Linux network performance by change TCP congestion control to BBR (Bottleneck Bandwidth and RTT).

djangocas.dev

It's enabled on our web servers now (download servers soon)

Anyone notice any subjective difference in the speed pages/images load?

Lew Zealand · Apr 9, 2023

Just loaded one of the pages in the Shadow of the Tomb Raider benchmark threads, which always contains loads of 1080p and 1440p screencaps and it loaded the pics pretty quickly. Seemingly much faster than before.

Veseleil · Apr 9, 2023

Seems faster, yes.

Solaris17 · Apr 9, 2023

W1zzard said:
Huge improve network performance by change TCP congestion control to BBR

BBR improve Linux server response time. Huge improve Linux network performance by change TCP congestion control to BBR (Bottleneck Bandwidth and RTT).

djangocas.dev

It's enabled on our web servers now (download servers soon)

Anyone notice any subjective difference in the speed pages/images load?

Not really yet but I havent navigated enough to perceive the "feel" of TPU change.

How did you check tc-fq status?

W1zzard · Apr 9, 2023

Solaris17 said:
Not really yet but I havent navigated enough to perceive the "feel" of TPU change.

How did you check tc-fq status?

# sysctl net.core.default_qdisc
net.core.default_qdisc = fq_codel
# sysctl net.ipv4.tcp_congestion_control
net.ipv4.tcp_congestion_control = bbr

Solaris17 · Apr 9, 2023

Looks like that kernel module isnt included in the azure kernels. Or doesnt build right for some reason. Neat.

P4-630 · Apr 9, 2023

It's quick, instant, hope it stays this way..

GerKNG · Apr 9, 2023

it's definitely a lot faster than before. Especially pictures and reviews/lists.

dgianstefani · Apr 9, 2023

Yep, faster.

Kodehawa · Apr 9, 2023

It's positively faster.

Selaya · Apr 10, 2023

faster.
absolutely.
neat.

W1zzard · Apr 10, 2023

BBR has been enabled on all our download servers too

ixi · Apr 10, 2023

No difference on my end. Feels smooth as before. Maybe I don't see the minimal changes.

Count von Schwalbe · Apr 10, 2023

Definitely faster, especially when the connection is dodgy.

Also no random hangs like I was having before

stinger608 · Apr 10, 2023

It does seem considerably quicker today.

Pictures are loading great and everything seems snappier than it has been.

P4-630 · Apr 10, 2023

Thought it was my new upgrades......

j/k

Processor	Ryzen 7 5700X
Memory	48 GB
Video Card(s)	RTX 4080
Storage	2x HDD RAID 1, 3x M.2 NVMe
Display(s)	30" 2560x1600 + 19" 1280x1024
Software	Windows 10 64-bit

System Name	Gamey #2 / #3
Processor	Ryzen 7 5800X3D / Ryzen 7 5700X3D
Motherboard	Asrock B450M P4 / MSi B450 ProVDH M
Cooling	IDCool SE-226-XT / IDCool SE-224-XTS
Memory	32GB 3200 CL16 / 16GB 3200 CL16
Video Card(s)	Red Dragon 6800 XT / Eagle 3070
Storage	4TB Team MP34 / 2TB WD SN570
Display(s)	LG 32GK650F 1440p 144Hz VA
Case	Corsair 4000Air / TT Versa H18
Power Supply	EVGA 650 G3 / EVGA BQ 500

System Name	1️Purple Haze 2️Vacuum Box
Processor	1️AMD Ryzen 7 5800X3D (-30 CO) 2️Intel Xeon E3-1241 v3
Motherboard	1️MSI B450 Tomahawk Max 2️Gigabyte GA-Z87X-UD5H
Cooling	1️Dark Rock 4 Pro, P14, P12, T30 case fans 2️212 Evo & P12 PWM PST x2, Arctic P14 & P12 case fans
Memory	1️32GB Ballistix (Micron E 19nm) CL16 @3733MHz 2️32GB HyperX Beast 2400MHz (XMP)
Video Card(s)	1️6900XTXH ASRock OC Formula LM'd & Phanteks T30x3 2️5700XT Sapphire Nitro+ LM'd & Arctic P12x2
Storage	1️ADATA SX8200 Pro 1TB, Toshiba P300 3TB x2 2️Kingston A400 120GB, Fanxiang S500 Pro 256GB
Display(s)	TCL C805 50" 2160p 144Hz VA miniLED, Mi 27" 1440p 165Hz IPS, AOC 24G2U 1080p 144Hz IPS
Case	1️Modded MS Industrial Titan II Pro RGB 2️Heavily Modded Cooler Master Q500L
Audio Device(s)	Audient iD14 MKII, Adam Audio T8Vs, Bloody M550, HiFiMan HE400se, Tascam TM-80, DS4 v2
Power Supply	1️Rosewill Capstone 1000M 2️Enermax Revolution X't 730W (both with P14 fans)
Mouse	Logitech G305, Bloody A91, Amazon basics, Logitech M187
Keyboard	Redragon K530, Bloody B930, Epomaker TH80 SE, BTC 9110
Software	W10LTSC 21H2, PBO2, FF, MusicBee, mpv, ImageGlass, OpenRGB, FanControl, Greenshot, DS4Win, Signal

System Name	RogueOne
Processor	Xeon W9-3495x
Motherboard	ASUS w790E Sage SE
Cooling	SilverStone XE360-4677
Memory	128gb Gskill Zeta R5 DDR5 RDIMMs
Video Card(s)	MSI SUPRIM Liquid 5090
Storage	1x 2TB WD SN850X \| 2x 8TB GAMMIX S70
Display(s)	49" Philips Evnia OLED (49M2C8900)
Case	Thermaltake Core P3 Pro Snow
Audio Device(s)	Moondrop S8's on Schitt Gunnr
Power Supply	Seasonic Prime TX-1600
Mouse	Razer Viper mini signature edition (mercury white)
Keyboard	Wooting 80 HE White, Gateron Jades
VR HMD	Quest 3
Software	Windows 11 Pro Workstation
Benchmark Scores	I dont have time for that.

Processor	Ryzen 7 5700X
Memory	48 GB
Video Card(s)	RTX 4080
Storage	2x HDD RAID 1, 3x M.2 NVMe
Display(s)	30" 2560x1600 + 19" 1280x1024
Software	Windows 10 64-bit

TCP BBR has been enabled on TPU's servers. Feedback?

W1zzard

Administrator

Huge improve network performance by change TCP congestion control to BBR

Lew Zealand

Veseleil

Solaris17

Super Dainty Moderator

Huge improve network performance by change TCP congestion control to BBR

W1zzard

Administrator

Solaris17

Super Dainty Moderator

P4-630

GerKNG

dgianstefani

TPU Proofreader

Kodehawa

Selaya

W1zzard

Administrator

ixi

Count von Schwalbe

Nocturnus Moderatus

stinger608

Dedicated TPU Cruncher & Folder

P4-630

System Name	AlderLake
Processor	Intel i7 12700K P-Cores @ 5Ghz
Motherboard	Gigabyte Z690 Aorus Master
Cooling	Noctua NH-U12A 2 fans + Thermal Grizzly Kryonaut Extreme + 5 case fans
Memory	32GB DDR5 Corsair Dominator Platinum RGB 6000MT/s CL36
Video Card(s)	MSI RTX 2070 Super Gaming X Trio
Storage	Samsung 980 Pro 1TB + 970 Evo 500GB + 850 Pro 512GB + 860 Evo 1TB x2
Display(s)	23.8" Dell S2417DG 165Hz G-Sync 1440p
Case	Be quiet! Silent Base 600 - Window
Audio Device(s)	Panasonic SA-PMX94 / Realtek onboard + B&O speaker system / Harman Kardon Go + Play / Logitech G533
Power Supply	Seasonic Focus Plus Gold 750W
Mouse	Logitech MX Anywhere 2 Laser wireless
Keyboard	RAPOO E9270P Black 5GHz wireless
Software	Windows 11
Benchmark Scores	Cinebench R23 (Single Core) 1936 @ stock Cinebench R23 (Multi Core) 23006 @ stock

Processor	AMD Ryzen 9 9950X3D
Motherboard	ASRock B850M PRO-A
Cooling	Corsair Nautilus 360 RS
Memory	2x32GB Kingston Fury Beast 6000 CL30
Video Card(s)	PowerColor Hellhound RX 9070 XT
Storage	1TB Samsung 990 Pro, 2TB Samsung 990 Pro, 4TB Samsung 990 Pro
Display(s)	LG 27GS95QE-B, MSI G272QPF E2
Case	Lian Li DAN Case A3 Black Wood Edition
Audio Device(s)	Bose Companion Series 2 III, Sennheiser GSP600 and HD599 SE - Creative Soundblaster X4
Power Supply	Corsair RM1000X ATX 3.1
Mouse	Razer Deathadder V3
Keyboard	Razer Black Widow V3 TKL
VR HMD	Oculus Rift S

System Name	Silent/X1 Yoga/S25U-1TB
Processor	Ryzen 9800X3D @ 5.4ghz AC 1.18 V, TG AM5 High Performance Heatspreader/1185 G7/Snapdragon 8 Elite
Motherboard	ASUS ROG Strix X870-I, chipset fans replaced with Noctua A14x25 G2
Cooling	Optimus Block, HWLabs Copper 240/40 x2, D5/Res, 4x Noctua A12x25, 1x A14G2, Conductonaut Extreme
Memory	64 GB Dominator Titanium White 6000 MT, 130 ns tRFC, active cooled, TG Putty Pro
Video Card(s)	RTX 3080 Ti Founders Edition, Conductonaut Extreme, 40 W/mK 3D Graphite pads, Corsair XG7 Waterblock
Storage	Intel Optane DC P1600X 118 GB, Samsung 990 Pro 2 TB
Display(s)	34" 240 Hz 3440x1440 34GS95Q LG MLA+ W-OLED, 31.5" 165 Hz 1440P NanoIPS Ultragear, MX900 dual VESA
Case	Sliger SM570 CNC Alu 13-Litre, 3D printed feet, TG Minuspad Extreme, LINKUP Ultra PCIe 4.0 x16 White
Audio Device(s)	Audeze Maxwell Ultraviolet w/upgrade pads & Leather LCD headband, Galaxy Buds 3 Pro, Razer Nommo Pro
Power Supply	SF1000 Plat, 13 A transparent custom cables, Sentinel Pro 1500 Online Double Conversion UPS w/Noctua
Mouse	Razer Viper V3 Pro 8 KHz Mercury White w/Pulsar Supergrip tape, Razer Atlas, Razer Strider Chroma
Keyboard	Wooting 60HE+ module, TOFU-R CNC Alu/Brass, SS Prismcaps W+Jellykey, LekkerL60 V2, TLabs Leath/Suede
Software	Windows 11 IoT Enterprise LTSC 24H2
Benchmark Scores	Legendary

System Name	Shinano
Processor	AMD Ryzen 9 5900X
Motherboard	ROG Strix B550-F GAMING WIFI II
Cooling	Thermalright Peerless Assassin 120SE
Memory	32GB DDR4 3200MHz
Video Card(s)	XFX RX 6700 10GB
Storage	970 EVO Plus 1TB \| A1000 480GB
Display(s)	Lenovo G27q-20 (1440p, 165Hz)
Case	NZXT H510
Audio Device(s)	Sony WH-1000XM4 \| Edifier R1000T4
Power Supply	SuperFlower Leadex Gold III 850W
Mouse	Logitech G305
Keyboard	Nuphy Air 75 \| IK75 v3 (QMK) \| HyperX Alloy Origins

System Name	2023 Ryzenfall
Processor	AMD Ryzen 5800X
Motherboard	Asus ROG STRIX B550-F Gaming Wifi
Cooling	SilverStone AH240 AIO
Memory	32 gigs G.Skill TridentZ NEO DDR4
Video Card(s)	EVGA GTX 1080 FTW Hybrid Gaming
Storage	Dual Samsung 980 Pro M2 NVME 4.0
Display(s)	Overlord 27" 2560 x 1440
Case	Corsair Air 540
Audio Device(s)	On board
Power Supply	Seasonic modular 850 watt Platinum
Software	Windows 10 Pro