• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

Best way to set up a huge 10~20TB for camera surveillance?

v12dock

Block Caption of Rainey Street
Supporter
Joined
Dec 18, 2008
Messages
1,959 (0.35/day)
I setup a storage server for surveillance we used WD blacks and RAID 0. I played with the raid controller for days trying to get the performance I was looking for
 
Joined
Feb 18, 2006
Messages
5,147 (0.78/day)
Location
AZ
System Name Thought I'd be done with this by now
Processor i7 11700k 8/16
Motherboard MSI Z590 Pro Wifi
Cooling Be Quiet Dark Rock Pro 4, 9x aigo AR12
Memory 32GB GSkill TridentZ Neo DDR4-4000 CL18-22-22-42
Video Card(s) MSI Ventus 2x Geforce RTX 3070
Storage 1TB MX300 M.2 OS + Games, + cloud mostly
Display(s) Samsung 40" 4k (TV)
Case Lian Li PC-011 Dynamic EVO Black
Audio Device(s) onboard HD -> Yamaha 5.1
Power Supply EVGA 850 GQ
Mouse Logitech wireless
Keyboard same
VR HMD nah
Software Windows 10
Benchmark Scores no one cares anymore lols
If you really need that much storage, DO NOT tie it down to one machine. You want the storage dtachable so that if the server goes you can restore image to another server and hook it up to the data.

A single workstation is usually not a good way to go (for something like this which is essentially a video server). You're better off building a super cheap server with detachable storage. Just my 2c. Also detachable storage usually has its own monitoring and alerting tools, which will make your life alot easier.

ah a poor mans SAN, interesting. When it comes to storage reliability SAN's are the creme of the crop so it does make more sense to try and move in that direction.

you could then setup 2-3 cheaper machines to hook to it in a high availability cluster. They don't take long to setup and will give instantaneous failover so you can fix the issue when you get to work in the morning rather than getting an alert in the middle of the night and having to hop out of bed and go down there to fix it.
 
Joined
Jun 18, 2010
Messages
2,329 (0.46/day)
Processor Intel i7 970 // Intel i7 2600K
Motherboard Asus Rampage III Formula // Asus P8P67 Deluxe
Cooling Zalman CNPS9900MaxB // Zalman CNPS11X
Memory GSkill 2133 12GB // Corsair V 2400 32GB
Video Card(s) ASUS GTX1080 // MSI GTX1070
Storage Samsung 870EVO // Samsung 840P
Display(s) HP w2207h
Case CoolerMaster Stacker 830se // Lian Li PC-9F
Audio Device(s) onboard
Power Supply Seasonic X 850w Gold // EVGA 850w G2
Mouse Logitech G502SE HERO, G9
Keyboard Dell
Software W10 Pro 22H2
Joined
Nov 13, 2007
Messages
10,233 (1.70/day)
Location
Austin Texas
Processor 13700KF Undervolted @ 5.6/ 5.5, 4.8Ghz Ring 200W PL1
Motherboard MSI 690-I PRO
Cooling Thermalright Peerless Assassin 120 w/ Arctic P12 Fans
Memory 48 GB DDR5 7600 MHZ CL36
Video Card(s) RTX 4090 FE
Storage 2x 2TB WDC SN850, 1TB Samsung 960 prr
Display(s) Alienware 32" 4k 240hz OLED
Case SLIGER S620
Audio Device(s) Yes
Power Supply Corsair SF750
Mouse Xlite V2
Keyboard RoyalAxe
Software Windows 11
Benchmark Scores They're pretty good, nothing crazy.
ah a poor mans SAN, interesting. When it comes to storage reliability SAN's are the creme of the crop so it does make more sense to try and move in that direction.

you could then setup 2-3 cheaper machines to hook to it in a high availability cluster. They don't take long to setup and will give instantaneous failover so you can fix the issue when you get to work in the morning rather than getting an alert in the middle of the night and having to hop out of bed and go down there to fix it.

Yeah that would be ideal - some applications don't love clustering, but if OP can do that he will save himself a good deal of gray hairs.
 
Joined
Oct 27, 2005
Messages
322 (0.05/day)
Location
Dublin, Ireland
System Name Kablamo
Processor Some Intel i5
Motherboard some gigabyte board
Cooling h80i
Memory samsung sticks that got a good review a few years back
Video Card(s) 6950 acting like a 6970
Storage some solid state ocz drives
Display(s) Samsung T260HD (1920 x 1200)
Case bitfenix microatx case
Audio Device(s) hyperx cloud II
Power Supply corsair 750 or similar
Mouse M65
Keyboard g510
Software win 10
I know Qnap have surveillence software built into their NAS range, but importantly they do motion detection. Not having your cameras active 24/7 could save you a lot of expense in terms of storage etc.
 
Joined
Jan 11, 2009
Messages
9,232 (1.65/day)
Location
Montreal, Canada
System Name Homelabs
Processor Ryzen 5900x | Ryzen 1920X
Motherboard Asus ProArt x570 Creator | AsRock X399 fatal1ty gaming
Cooling Silent Loop 2 280mm | Dark Rock Pro TR4
Memory 128GB (4x32gb) DDR4 3600Mhz | 128GB (8x16GB) DDR4 2933Mhz
Video Card(s) EVGA RTX 3080 | ASUS Strix GTX 970
Storage Optane 900p + NVMe | Optane 900p + 8TB SATA SSDs + 48TB HDDs
Display(s) Alienware AW3423dw QD-OLED | HP Omen 32 1440p
Case be quiet! Dark Base Pro 900 rev 2 | be quiet! Silent Base 800
Power Supply Corsair RM750x + sleeved cables| EVGA P2 750W
Mouse Razer Viper Ultimate (still has buttons on the right side, crucial as I'm a southpaw)
Keyboard Razer Huntsman Elite, Pro Type | Logitech G915 TKL
They are going to be motion detection, but the busiest cameras will be on a good 14~15 hours a day, and the least busy will probably be about 6 hours.

Considering that the data isn't that critical and we can afford to loose it in rare circumstances, and I just don't have much space in that office, and I want it to be cheap, I'm leaning towards having either an internal RAID array.

How do RAID Controllers work? and what are those multi-lane things? Do you get a multi-lane to 4 SATA port adapter and plug in the hard drives to that and that's it? you don't even need to use your mobo's SATA ports (except for the OS drive) ? So if I have the OS drive connected to the mobo and then I can connect 8 HDDs in RAID onto the controller right? Seems like the simplest and cheapest solution to me

SAN, NAS etc are nice but aren't worth it for my uses IMO. Sure I can afford it but it just seems like a waste of money
 
Joined
Jun 18, 2010
Messages
2,329 (0.46/day)
Processor Intel i7 970 // Intel i7 2600K
Motherboard Asus Rampage III Formula // Asus P8P67 Deluxe
Cooling Zalman CNPS9900MaxB // Zalman CNPS11X
Memory GSkill 2133 12GB // Corsair V 2400 32GB
Video Card(s) ASUS GTX1080 // MSI GTX1070
Storage Samsung 870EVO // Samsung 840P
Display(s) HP w2207h
Case CoolerMaster Stacker 830se // Lian Li PC-9F
Audio Device(s) onboard
Power Supply Seasonic X 850w Gold // EVGA 850w G2
Mouse Logitech G502SE HERO, G9
Keyboard Dell
Software W10 Pro 22H2
Joined
Jan 11, 2009
Messages
9,232 (1.65/day)
Location
Montreal, Canada
System Name Homelabs
Processor Ryzen 5900x | Ryzen 1920X
Motherboard Asus ProArt x570 Creator | AsRock X399 fatal1ty gaming
Cooling Silent Loop 2 280mm | Dark Rock Pro TR4
Memory 128GB (4x32gb) DDR4 3600Mhz | 128GB (8x16GB) DDR4 2933Mhz
Video Card(s) EVGA RTX 3080 | ASUS Strix GTX 970
Storage Optane 900p + NVMe | Optane 900p + 8TB SATA SSDs + 48TB HDDs
Display(s) Alienware AW3423dw QD-OLED | HP Omen 32 1440p
Case be quiet! Dark Base Pro 900 rev 2 | be quiet! Silent Base 800
Power Supply Corsair RM750x + sleeved cables| EVGA P2 750W
Mouse Razer Viper Ultimate (still has buttons on the right side, crucial as I'm a southpaw)
Keyboard Razer Huntsman Elite, Pro Type | Logitech G915 TKL
The standard camera software takes care of remote accessibility, and wouldn't it be more reliable to use the RAID controllers + internal HDDs? better cooling, more direct...
 
Joined
Feb 7, 2006
Messages
738 (0.11/day)
Location
Austin, TX
System Name WAZAAM!
Processor AMD Ryzen 3900x
Motherboard ASRock Fatal1ty X370 Pro Gaming
Cooling Kraken x62
Memory G.Skill 16GB 3200 MHz
Video Card(s) EVGA GeForce GTX 1070 8GB SC
Storage Micron 9200 Max
Display(s) Samsung 49" 5120x1440 120hz
Case Corsair 600D
Audio Device(s) Onboard - Bose Companion 2 Speakers
Power Supply CORSAIR Professional Series HX850
Keyboard Corsair K95 RGB
Software Windows 10 Pro
For reference, a Dell server with 10TB of useable storage (6x2TB drives in RAID5) would be about $3k with a 3 year basic onsite warranty.

Can you rackmount this? or does it need to be standalone?
 
Joined
Jan 11, 2009
Messages
9,232 (1.65/day)
Location
Montreal, Canada
System Name Homelabs
Processor Ryzen 5900x | Ryzen 1920X
Motherboard Asus ProArt x570 Creator | AsRock X399 fatal1ty gaming
Cooling Silent Loop 2 280mm | Dark Rock Pro TR4
Memory 128GB (4x32gb) DDR4 3600Mhz | 128GB (8x16GB) DDR4 2933Mhz
Video Card(s) EVGA RTX 3080 | ASUS Strix GTX 970
Storage Optane 900p + NVMe | Optane 900p + 8TB SATA SSDs + 48TB HDDs
Display(s) Alienware AW3423dw QD-OLED | HP Omen 32 1440p
Case be quiet! Dark Base Pro 900 rev 2 | be quiet! Silent Base 800
Power Supply Corsair RM750x + sleeved cables| EVGA P2 750W
Mouse Razer Viper Ultimate (still has buttons on the right side, crucial as I'm a southpaw)
Keyboard Razer Huntsman Elite, Pro Type | Logitech G915 TKL
Isn't rackmount much more expensive?
 
Joined
Feb 7, 2006
Messages
738 (0.11/day)
Location
Austin, TX
System Name WAZAAM!
Processor AMD Ryzen 3900x
Motherboard ASRock Fatal1ty X370 Pro Gaming
Cooling Kraken x62
Memory G.Skill 16GB 3200 MHz
Video Card(s) EVGA GeForce GTX 1070 8GB SC
Storage Micron 9200 Max
Display(s) Samsung 49" 5120x1440 120hz
Case Corsair 600D
Audio Device(s) Onboard - Bose Companion 2 Speakers
Power Supply CORSAIR Professional Series HX850
Keyboard Corsair K95 RGB
Software Windows 10 Pro
Isn't rackmount much more expensive?

Yes and No.

If you're only looking at the switch and storage(/server) then standalone will be less. If you have a rack environment then you will have more expandability with rackmount (a 24 drive chassis for example)
 
Joined
Feb 18, 2006
Messages
5,147 (0.78/day)
Location
AZ
System Name Thought I'd be done with this by now
Processor i7 11700k 8/16
Motherboard MSI Z590 Pro Wifi
Cooling Be Quiet Dark Rock Pro 4, 9x aigo AR12
Memory 32GB GSkill TridentZ Neo DDR4-4000 CL18-22-22-42
Video Card(s) MSI Ventus 2x Geforce RTX 3070
Storage 1TB MX300 M.2 OS + Games, + cloud mostly
Display(s) Samsung 40" 4k (TV)
Case Lian Li PC-011 Dynamic EVO Black
Audio Device(s) onboard HD -> Yamaha 5.1
Power Supply EVGA 850 GQ
Mouse Logitech wireless
Keyboard same
VR HMD nah
Software Windows 10
Benchmark Scores no one cares anymore lols
Isn't rackmount much more expensive?

nope the rack itself is, but the rackmounted server isn't. kinda moot when it sounds like you don't already have a rack to put it in though.
 
Joined
Jan 11, 2009
Messages
9,232 (1.65/day)
Location
Montreal, Canada
System Name Homelabs
Processor Ryzen 5900x | Ryzen 1920X
Motherboard Asus ProArt x570 Creator | AsRock X399 fatal1ty gaming
Cooling Silent Loop 2 280mm | Dark Rock Pro TR4
Memory 128GB (4x32gb) DDR4 3600Mhz | 128GB (8x16GB) DDR4 2933Mhz
Video Card(s) EVGA RTX 3080 | ASUS Strix GTX 970
Storage Optane 900p + NVMe | Optane 900p + 8TB SATA SSDs + 48TB HDDs
Display(s) Alienware AW3423dw QD-OLED | HP Omen 32 1440p
Case be quiet! Dark Base Pro 900 rev 2 | be quiet! Silent Base 800
Power Supply Corsair RM750x + sleeved cables| EVGA P2 750W
Mouse Razer Viper Ultimate (still has buttons on the right side, crucial as I'm a southpaw)
Keyboard Razer Huntsman Elite, Pro Type | Logitech G915 TKL
Haha yea this is going to be in the middle of an office so there are no racks
 
Joined
Jun 18, 2010
Messages
2,329 (0.46/day)
Processor Intel i7 970 // Intel i7 2600K
Motherboard Asus Rampage III Formula // Asus P8P67 Deluxe
Cooling Zalman CNPS9900MaxB // Zalman CNPS11X
Memory GSkill 2133 12GB // Corsair V 2400 32GB
Video Card(s) ASUS GTX1080 // MSI GTX1070
Storage Samsung 870EVO // Samsung 840P
Display(s) HP w2207h
Case CoolerMaster Stacker 830se // Lian Li PC-9F
Audio Device(s) onboard
Power Supply Seasonic X 850w Gold // EVGA 850w G2
Mouse Logitech G502SE HERO, G9
Keyboard Dell
Software W10 Pro 22H2
Joined
Mar 10, 2010
Messages
11,878 (2.30/day)
Location
Manchester uk
System Name RyzenGtEvo/ Asus strix scar II
Processor Amd R5 5900X/ Intel 8750H
Motherboard Crosshair hero8 impact/Asus
Cooling 360EK extreme rad+ 360$EK slim all push, cpu ek suprim Gpu full cover all EK
Memory Corsair Vengeance Rgb pro 3600cas14 16Gb in four sticks./16Gb/16GB
Video Card(s) Powercolour RX7900XT Reference/Rtx 2060
Storage Silicon power 2TB nvme/8Tb external/1Tb samsung Evo nvme 2Tb sata ssd/1Tb nvme
Display(s) Samsung UAE28"850R 4k freesync.dell shiter
Case Lianli 011 dynamic/strix scar2
Audio Device(s) Xfi creative 7.1 on board ,Yamaha dts av setup, corsair void pro headset
Power Supply corsair 1200Hxi/Asus stock
Mouse Roccat Kova/ Logitech G wireless
Keyboard Roccat Aimo 120
VR HMD Oculus rift
Software Win 10 Pro
Benchmark Scores 8726 vega 3dmark timespy/ laptop Timespy 6506
wizz has his shit in order in all the above listen to him,
ive used shity caviar blues(250) x3 in raid 0 for going on 5 years and only one has bit the dirt ,i now have four as i replaced 1 with 2 as they were half price then.

they last ages even cheap ones if kept below 40 degrees and above 30, and on a 10x sata raid board 8x 2.5TB drives ,say an asrock 990FX extreme 4 with an 8120cpu;), wizz you know this better for server type stuff and encodeing:) and that 2mb cache might actually get used by you , you will be able to multi soft raid ie you dont have to make just 1x array you could make 2, and software raid overclocks;) hardware does not:)
 
Joined
Jan 11, 2009
Messages
9,232 (1.65/day)
Location
Montreal, Canada
System Name Homelabs
Processor Ryzen 5900x | Ryzen 1920X
Motherboard Asus ProArt x570 Creator | AsRock X399 fatal1ty gaming
Cooling Silent Loop 2 280mm | Dark Rock Pro TR4
Memory 128GB (4x32gb) DDR4 3600Mhz | 128GB (8x16GB) DDR4 2933Mhz
Video Card(s) EVGA RTX 3080 | ASUS Strix GTX 970
Storage Optane 900p + NVMe | Optane 900p + 8TB SATA SSDs + 48TB HDDs
Display(s) Alienware AW3423dw QD-OLED | HP Omen 32 1440p
Case be quiet! Dark Base Pro 900 rev 2 | be quiet! Silent Base 800
Power Supply Corsair RM750x + sleeved cables| EVGA P2 750W
Mouse Razer Viper Ultimate (still has buttons on the right side, crucial as I'm a southpaw)
Keyboard Razer Huntsman Elite, Pro Type | Logitech G915 TKL
Spying on employees???

It's in the middle of the Boss' office lol, and he actually has meeting with people in there (office is tiny, we got 3 offices and one of them is in the Boss' closet). The cameras are for a grocery store, and they both look over employees (they steal money sometimes, give free stuff to their friends, steal food themselves, or sue us for injury that they never had) and basically anywhere in the store to watch for shoplifters.
 
Joined
Jun 18, 2010
Messages
2,329 (0.46/day)
Processor Intel i7 970 // Intel i7 2600K
Motherboard Asus Rampage III Formula // Asus P8P67 Deluxe
Cooling Zalman CNPS9900MaxB // Zalman CNPS11X
Memory GSkill 2133 12GB // Corsair V 2400 32GB
Video Card(s) ASUS GTX1080 // MSI GTX1070
Storage Samsung 870EVO // Samsung 840P
Display(s) HP w2207h
Case CoolerMaster Stacker 830se // Lian Li PC-9F
Audio Device(s) onboard
Power Supply Seasonic X 850w Gold // EVGA 850w G2
Mouse Logitech G502SE HERO, G9
Keyboard Dell
Software W10 Pro 22H2
If the office is small and this is going to be used for 1 purpose only (not the boss's dual use desktop/security system) why not go for a wall mount rack system. Out of the way with no one to kick it or take up desk space. Just kicking around ideas.

Well at least you didn't say you were covering the washroom!:laugh:
 
Joined
Jan 11, 2009
Messages
9,232 (1.65/day)
Location
Montreal, Canada
System Name Homelabs
Processor Ryzen 5900x | Ryzen 1920X
Motherboard Asus ProArt x570 Creator | AsRock X399 fatal1ty gaming
Cooling Silent Loop 2 280mm | Dark Rock Pro TR4
Memory 128GB (4x32gb) DDR4 3600Mhz | 128GB (8x16GB) DDR4 2933Mhz
Video Card(s) EVGA RTX 3080 | ASUS Strix GTX 970
Storage Optane 900p + NVMe | Optane 900p + 8TB SATA SSDs + 48TB HDDs
Display(s) Alienware AW3423dw QD-OLED | HP Omen 32 1440p
Case be quiet! Dark Base Pro 900 rev 2 | be quiet! Silent Base 800
Power Supply Corsair RM750x + sleeved cables| EVGA P2 750W
Mouse Razer Viper Ultimate (still has buttons on the right side, crucial as I'm a southpaw)
Keyboard Razer Huntsman Elite, Pro Type | Logitech G915 TKL
It's going to be used mostly to view the video surveillance and save the parts we need on an external HDD and/or USB etc, so the USB ports have to be accessible

Maybe I could just put the PC in the backroom and have long USB extenders/hubs for my USB needs and a long DVI or HDMI cable for the display!
 
Top