• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

Setting up a file server

[Ion]

WCG Team Assistant
Joined
Sep 15, 2009
Messages
13,391 (2.53/day)
Location
Raleigh, North Carolina, United States
System Name Niedersachsen / Ribe / Minsk
Processor i3 3240 / i7-3520M / 4x Opteron 6376 @ 2.86GHz
Motherboard BIOSTAR H61M / HP Q77 / Supermicro H8QG7
Cooling Stock / Stock / 4x 1U G34
Memory 1x8GB / 2x4GB / 4x4GB
Video Card(s) GTX260 / Intel HD 4000 / nVidia GT310
Storage 80GB Intel SSD / 256GB Intel SSD / 2x 60GB SSD (RAID1)
Display(s) Dell 3007 + HP 2245w / 12.1" 1366x768 / None
Case Antec NSK3480 / HP / Supermicro 1U
Audio Device(s) Onboard
Power Supply Enermax 500W / HP 130W / Supermicro Gold 1400W
Keyboard IBM Model M
Software Windows 7 (Niedersachsen/Ribe) / Linux Mint 17.2 (Minsk)
I've realized that it's impractical and insecure to keep my big files (movies, music, TV shows, pictures) on a single 1TB drive. Consequently, I'm looking to build a file server. Currently, I have a pair of 1TB Caviar Green drives. I'm determined to have either a RAID1 or RAID5 array so I have a degree of redundancy in case something goes south. I've also already managed to fill up about 2/3 of my 1TB drive, so I'm thinking of adding a third drive for RAID5 so that I can expand a bit more.

My most basic requirement is a system with at least 100 megabit ethernet (ideally gigabit) that can redundantly store at least 1TB of files and be accessible (read & write) from a Windows PC. RAID5 is not strictly required but is highly desired.

Less pressing features (but still ones I would like) are a web/interface or web server for it, the ability to run a Bittorrent client, the ability to have multiple password-protected accounts so that I can give friends access at school, and a FTP server. Something that I could configure easily is a bonus.

If I can run a VPN through this system or run WCG on it, those are added benefits but not required. I can get any version of Windows for free from school--not an issue there ;)

In terms of hardware, I'm thinking of using a Penryn Pentium Dual Core on probably an Asus G31 board w/ ~2GB+ RAM and an 80GB boot drive.

Suggestions? :)
 
Joined
Jan 11, 2013
Messages
1,237 (0.30/day)
Location
California, unfortunately.
System Name Sierra ~ Server
Processor Core i5-11600K ~ Core i3-12100
Motherboard Asus Prime B560M-A AC ~ MSI PRO B760M-P
Cooling CM 212 Black RGB Edition ~ Intel Stock Cooler
Memory 64GB (2x 32GB) DDR4-3600 ~ 32GB (4x 8GB) DDR4-3200
Video Card(s) XFX Radeon RX 6950 XT ~ EVGA GeForce GTX 970
Storage 4TB Samsung 990 Pro with Heatsink NVMe SSD ~ 2TB Kingston NV1 NVMe SSD + 500GB WD Blue SATA SSD
Display(s) 2x Dell S2721QS 4K 60Hz ~ N/A
Case Asus Prime AP201 - Open Frame Chassis
Power Supply Thermaltake GF1 850W ~ Thermaltake Smart 500W
Software Windows 11 Pro ~ Proxmox VE
Benchmark Scores Laptops: Dell Latitude E7270, Dell Latitude 14 Rugged 5420.
I would highly recommend RAID10 with four drives... WD Red 3TB's would do you perfectly well for this purpose. Pentium Dual Core will be plenty. Would recommend 4GB RAM just for the heck of it and it's cheap.
 

MxPhenom 216

ASIC Engineer
Joined
Aug 31, 2010
Messages
12,944 (2.62/day)
Location
Loveland, CO
System Name Ryzen Reflection
Processor AMD Ryzen 9 5900x
Motherboard Gigabyte X570S Aorus Master
Cooling 2x EK PE360 | TechN AM4 AMD Block Black | EK Quantum Vector Trinity GPU Nickel + Plexi
Memory Teamgroup T-Force Xtreem 2x16GB B-Die 3600 @ 14-14-14-28-42-288-2T 1.45v
Video Card(s) Zotac AMP HoloBlack RTX 3080Ti 12G | 950mV 1950Mhz
Storage WD SN850 500GB (OS) | Samsung 980 Pro 1TB (Games_1) | Samsung 970 Evo 1TB (Games_2)
Display(s) Asus XG27AQM 240Hz G-Sync Fast-IPS | Gigabyte M27Q-P 165Hz 1440P IPS | Asus 24" IPS (portrait mode)
Case Lian Li PC-011D XL | Custom cables by Cablemodz
Audio Device(s) FiiO K7 | Sennheiser HD650 + Beyerdynamic FOX Mic
Power Supply Seasonic Prime Ultra Platinum 850
Mouse Razer Viper v2 Pro
Keyboard Razer Huntsman Tournament Edition
Software Windows 11 Pro 64-Bit
Since you only running two drives. Just run a RAID1. I rebuilt my old dell desktop into a file server to keep all my GoPro videos and edited videos on. Running 2 2TB WD Reds in Raid1. perfect little file server for what I need.
 

[Ion]

WCG Team Assistant
Joined
Sep 15, 2009
Messages
13,391 (2.53/day)
Location
Raleigh, North Carolina, United States
System Name Niedersachsen / Ribe / Minsk
Processor i3 3240 / i7-3520M / 4x Opteron 6376 @ 2.86GHz
Motherboard BIOSTAR H61M / HP Q77 / Supermicro H8QG7
Cooling Stock / Stock / 4x 1U G34
Memory 1x8GB / 2x4GB / 4x4GB
Video Card(s) GTX260 / Intel HD 4000 / nVidia GT310
Storage 80GB Intel SSD / 256GB Intel SSD / 2x 60GB SSD (RAID1)
Display(s) Dell 3007 + HP 2245w / 12.1" 1366x768 / None
Case Antec NSK3480 / HP / Supermicro 1U
Audio Device(s) Onboard
Power Supply Enermax 500W / HP 130W / Supermicro Gold 1400W
Keyboard IBM Model M
Software Windows 7 (Niedersachsen/Ribe) / Linux Mint 17.2 (Minsk)
I would highly recommend RAID10 with four drives... WD Red 3TB's would do you perfectly well for this purpose. Pentium Dual Core will be plenty. Would recommend 4GB RAM just for the heck of it and it's cheap.
The problem is that's expensive---I already have the two 1TB drives and I can get a third for about $30. And I think that 2TB of space is plenty for the foreseeable future.
Since you only running two drives. Just run a RAID1. I rebuilt my old dell desktop into a file server to keep all my GoPro videos and edited videos on. Running 2 2TB WD Reds in Raid1. perfect little file server for what I need.

As I said, I'd really like to get a third for RAID5 and double my capacity. For $30 I think it's worth it.

And I can certainly go 4GB RAM--that's cheap. I have the RAM to do that sitting on my desk :)
 
Joined
Jan 11, 2013
Messages
1,237 (0.30/day)
Location
California, unfortunately.
System Name Sierra ~ Server
Processor Core i5-11600K ~ Core i3-12100
Motherboard Asus Prime B560M-A AC ~ MSI PRO B760M-P
Cooling CM 212 Black RGB Edition ~ Intel Stock Cooler
Memory 64GB (2x 32GB) DDR4-3600 ~ 32GB (4x 8GB) DDR4-3200
Video Card(s) XFX Radeon RX 6950 XT ~ EVGA GeForce GTX 970
Storage 4TB Samsung 990 Pro with Heatsink NVMe SSD ~ 2TB Kingston NV1 NVMe SSD + 500GB WD Blue SATA SSD
Display(s) 2x Dell S2721QS 4K 60Hz ~ N/A
Case Asus Prime AP201 - Open Frame Chassis
Power Supply Thermaltake GF1 850W ~ Thermaltake Smart 500W
Software Windows 11 Pro ~ Proxmox VE
Benchmark Scores Laptops: Dell Latitude E7270, Dell Latitude 14 Rugged 5420.
The problem is that's expensive---I already have the two 1TB drives and I can get a third for about $30. And I think that 2TB of space is plenty for the foreseeable future.


As I said, I'd really like to get a third for RAID5 and double my capacity. For $30 I think it's worth it.

And I can certainly go 4GB RAM--that's cheap. I have the RAM to do that sitting on my desk :)

As an administrator who manages tons of servers on a daily basis (enterprise grade servers in a real datacenter) I absolutely hate RAID5. Then again, that's on multi-tenant servers running shared hosting/VPS... we don't have a single dedicated server customer running RAID5... we set up dedicated servers for customers that order them, with 1 or 10. For a personal file server I am sure RAID5 would be fine, though :) I'd be worried about filling up all your space soon it you went with the 1TB drives, since you mentioned that, that's why I suggested 4x 2TB. But understandably you want to save money, and ultimately only you know how much storage you need, so I will stand down :)
 
Joined
Nov 16, 2007
Messages
1,166 (0.20/day)
Location
Hampton Roads
Processor Xeon x5650
Motherboard SABERTOOTH X58
Cooling Fans
Memory 24 GB Kingston HyperX 1600
Video Card(s) GTX 1060 3GB
Storage small ssd
Display(s) Dell 2001F, BenQ short throw
Case Lian Li
Audio Device(s) onboard
Power Supply X750
Software Mint 19.3, Win 10
Benchmark Scores not so fast...
As far as WebUI, I use HFS. HTTP File Server. Gets me all my stuff anywhere. Really handy with Android OS.
 

Aquinus

Resident Wat-man
Joined
Jan 28, 2012
Messages
13,147 (2.97/day)
Location
Concord, NH, USA
System Name Apollo
Processor Intel Core i9 9880H
Motherboard Some proprietary Apple thing.
Memory 64GB DDR4-2667
Video Card(s) AMD Radeon Pro 5600M, 8GB HBM2
Storage 1TB Apple NVMe, 4TB External
Display(s) Laptop @ 3072x1920 + 2x LG 5k Ultrafine TB3 displays
Case MacBook Pro (16", 2019)
Audio Device(s) AirPods Pro, Sennheiser HD 380s w/ FIIO Alpen 2, or Logitech 2.1 Speakers
Power Supply 96w Power Adapter
Mouse Logitech MX Master 3
Keyboard Logitech G915, GL Clicky
Software MacOS 12.1
As an administrator who manages tons of servers on a daily basis (enterprise grade servers in a real datacenter) I absolutely hate RAID5. Then again, that's on multi-tenant servers running shared hosting/VPS... we don't have a single dedicated server customer running RAID5... we set up dedicated servers for customers that order them, with 1 or 10. For a personal file server I am sure RAID5 would be fine, though :) I'd be worried about filling up all your space soon it you went with the 1TB drives, since you mentioned that, that's why I suggested 4x 2TB. But understandably you want to save money, and ultimately only you know how much storage you need, so I will stand down :)

First of all, running multiple VMs on a single box requires potentially significant write speed so that VMs could benefit from RAID-10. Not for this case though, most of what the RAID-5 will be doing is reading and holding on to data. Also, I don't know how you can make such a recommendation being a "system admin who manages tons of servers on a daily basis" because I manage private servers that aren't shared and RAID-5 and RAID-6 are the best RAID modes if you have a lot of mission critical data where losing data is unacceptable and is paramount over all else.

Also a good admin will know how to minimize cost and adapt a server to the needs of the person or institutions so I'm going to call shenanigans.

All in all, no one should never consider RAID-10 unless they absolutely need it, otherwise it's a waste of capacity. We're also talking about storing files, not VM images of entire OSs.

My take is: Get the extra disk and go RAID-5. At least that way you will get the added benefit of data being striped across 3 disks as opposed to only duplicating data on 2, so your read speeds should be improved and it will only require you to get one more drive, so I like that idea. Write speeds should even be better despite having to write parity because now you're stripping data as opposed to duplicating it.

I have RAID-5 and it has saved me from headache multiple times. I shun all nay Sayers of RAID-5 and 6. For strictly a file server, capacity and redundancy is much more important than performance IMHO.
 

Mindweaver

Moderato®™
Staff member
Joined
Apr 16, 2009
Messages
8,193 (1.50/day)
Location
Charleston, SC
System Name Tower of Power / Sechs
Processor i7 14700K / i7 5820k @ 4.5ghz
Motherboard ASUS ROG Strix Z690-A Gaming WiFi D4 / X99S GAMING 7
Cooling CM MasterLiquid ML360 Mirror ARGB Close-Loop AIO / CORSAIR Hydro Series H100i Extreme
Memory CORSAIR Vengeance LPX 32GB (2 x 16GB) DDR4 3600 / G.Skill DDR4 2800 16GB 4x4GB
Video Card(s) ASUS TUF Gaming GeForce RTX 4070 Ti / ASUS TUF Gaming GeForce RTX 3070 V2 OC Edition
Storage 4x Samsung 980 Pro 1TB M.2, 2x Crucial 1TB SSD / Samsung 870 PRO 500GB M.2
Display(s) Samsung 32" Odyssy G5 Gaming 144hz 1440p, ViewSonic 32" 72hz 1440p / 2x ViewSonic 32" 72hz 1440p
Case Phantek "400A" / Phanteks “Enthoo Pro series”
Audio Device(s) Realtek ALC4080 / Azalia Realtek ALC1150
Power Supply Corsair RM Series RM750 / Corsair CXM CX600M
Mouse Glorious Gaming Model D Wireless / Razer DeathAdder Chroma
Keyboard Glorious GMMK with box-white switches / Keychron K6 pro with blue swithes
VR HMD Quest 3 (128gb) + Rift S + HTC Vive + DK1
Software Windows 11 Pro x64 / Windows 10 Pro x64
Benchmark Scores Yes
I agree with Aquinus and say go with a RAID-5 setup, but only if you are going to use a hardware RAID with a BBU, and not Software (I think Aquinus and shovenose would agree). If you plan to use software then do yourself a favor, and setup a RAID1 array. I would never setup a RAID10 array for home use mainly due to cost. Then again I would never setup a RAID-5 with out a backup drive on hand either. Since we are pulling our junk out, and measuring then I've been a CIO/IT Manager for over 16 years. :p
 
Last edited:

[Ion]

WCG Team Assistant
Joined
Sep 15, 2009
Messages
13,391 (2.53/day)
Location
Raleigh, North Carolina, United States
System Name Niedersachsen / Ribe / Minsk
Processor i3 3240 / i7-3520M / 4x Opteron 6376 @ 2.86GHz
Motherboard BIOSTAR H61M / HP Q77 / Supermicro H8QG7
Cooling Stock / Stock / 4x 1U G34
Memory 1x8GB / 2x4GB / 4x4GB
Video Card(s) GTX260 / Intel HD 4000 / nVidia GT310
Storage 80GB Intel SSD / 256GB Intel SSD / 2x 60GB SSD (RAID1)
Display(s) Dell 3007 + HP 2245w / 12.1" 1366x768 / None
Case Antec NSK3480 / HP / Supermicro 1U
Audio Device(s) Onboard
Power Supply Enermax 500W / HP 130W / Supermicro Gold 1400W
Keyboard IBM Model M
Software Windows 7 (Niedersachsen/Ribe) / Linux Mint 17.2 (Minsk)
I agree with Aquinus and say go with a RAID-5 setup, but only if you are going to use a hardware RAID with a BBU, and not Software (I think Aquinus and shovenose would agree). If you plan to use software then do yourself a favor, and setup a RAID1 array. I would never setup a RAID10 array for home use mainly due to cost. Then again I would never setup a RAID-5 with out a backup drive on hand either. Since we are pulling our junk out, and measuring then I've been a CIO/IT Manager for over 16 years. :p

I'll have to check and see what sort of board I'll be putting it on, but I'd say that there's a good chance it would have to be software RAID. I don't think that the G31 board I'm planning on supports HW Raid5 (not sure if it supports hardware RAID at all). Why would software RAID5 be a problem? Wouldn't a 2.5GHz+ Penryn CPU be enough to handle that? I definitely think that RAID10 is more expensive than I need ATM, and would be a poor use of resources.

I suppose I'm mostly wondering what operating system should I use? A Windows Server variant, some mainstream Linux OS (Ubuntu/etc) or a specialized file server Linux distro? Would I want to use my 80GB disk for boot and then have a RAID array for data?

I think that a 3x1TB RAID5 array would be plenty--that would have about 3x as much storage space as I'm currently using, so there would be considerable room to grow.
 

Mindweaver

Moderato®™
Staff member
Joined
Apr 16, 2009
Messages
8,193 (1.50/day)
Location
Charleston, SC
System Name Tower of Power / Sechs
Processor i7 14700K / i7 5820k @ 4.5ghz
Motherboard ASUS ROG Strix Z690-A Gaming WiFi D4 / X99S GAMING 7
Cooling CM MasterLiquid ML360 Mirror ARGB Close-Loop AIO / CORSAIR Hydro Series H100i Extreme
Memory CORSAIR Vengeance LPX 32GB (2 x 16GB) DDR4 3600 / G.Skill DDR4 2800 16GB 4x4GB
Video Card(s) ASUS TUF Gaming GeForce RTX 4070 Ti / ASUS TUF Gaming GeForce RTX 3070 V2 OC Edition
Storage 4x Samsung 980 Pro 1TB M.2, 2x Crucial 1TB SSD / Samsung 870 PRO 500GB M.2
Display(s) Samsung 32" Odyssy G5 Gaming 144hz 1440p, ViewSonic 32" 72hz 1440p / 2x ViewSonic 32" 72hz 1440p
Case Phantek "400A" / Phanteks “Enthoo Pro series”
Audio Device(s) Realtek ALC4080 / Azalia Realtek ALC1150
Power Supply Corsair RM Series RM750 / Corsair CXM CX600M
Mouse Glorious Gaming Model D Wireless / Razer DeathAdder Chroma
Keyboard Glorious GMMK with box-white switches / Keychron K6 pro with blue swithes
VR HMD Quest 3 (128gb) + Rift S + HTC Vive + DK1
Software Windows 11 Pro x64 / Windows 10 Pro x64
Benchmark Scores Yes
I'll have to check and see what sort of board I'll be putting it on, but I'd say that there's a good chance it would have to be software RAID. I don't think that the G31 board I'm planning on supports HW Raid5 (not sure if it supports hardware RAID at all). Why would software RAID5 be a problem? Wouldn't a 2.5GHz+ Penryn CPU be enough to handle that? I definitely think that RAID10 is more expensive than I need ATM, and would be a poor use of resources.

I suppose I'm mostly wondering what operating system should I use? A Windows Server variant, some mainstream Linux OS (Ubuntu/etc) or a specialized file server Linux distro? Would I want to use my 80GB disk for boot and then have a RAID array for data?

I think that a 3x1TB RAID5 array would be plenty--that would have about 3x as much storage space as I'm currently using, so there would be considerable room to grow.

With it being just a file server it should be fine, but you'll lose speed with out a BBU. Using a BBU you'll be able to use write-back meaning if power is lost all the write requests are put into cache, and when power is returned it picks up where it powered off using the requests stored in cache. but with out a BBU you'll use write-through which means everything wrote won't go to cache and it will be wrote as soon as it gets the request. So, it's slower compared to using a BBU. :toast:

Now what OS to use.. I'd probably go with CentOS or Debian... But any should do :toast:
 

[Ion]

WCG Team Assistant
Joined
Sep 15, 2009
Messages
13,391 (2.53/day)
Location
Raleigh, North Carolina, United States
System Name Niedersachsen / Ribe / Minsk
Processor i3 3240 / i7-3520M / 4x Opteron 6376 @ 2.86GHz
Motherboard BIOSTAR H61M / HP Q77 / Supermicro H8QG7
Cooling Stock / Stock / 4x 1U G34
Memory 1x8GB / 2x4GB / 4x4GB
Video Card(s) GTX260 / Intel HD 4000 / nVidia GT310
Storage 80GB Intel SSD / 256GB Intel SSD / 2x 60GB SSD (RAID1)
Display(s) Dell 3007 + HP 2245w / 12.1" 1366x768 / None
Case Antec NSK3480 / HP / Supermicro 1U
Audio Device(s) Onboard
Power Supply Enermax 500W / HP 130W / Supermicro Gold 1400W
Keyboard IBM Model M
Software Windows 7 (Niedersachsen/Ribe) / Linux Mint 17.2 (Minsk)
With it being just a file server it should be fine, but you'll lose speed with out a BBU. Using a BBU you'll be able to use write-back meaning if power is lost all the write requests are put into cache, and when power is returned it picks up where it powered off using the requests stored in cache. but with out a BBU you'll use write-through which means everything wrote won't go to cache and it will be wrote as soon as it gets the request. So, it's slower compared to using a BBU. :toast:

Now what OS to use.. I'd probably go with CentOS or Debian... But any should do :toast:

My only real requirement in terms of speed is the ability to play a HD movie or TV show from the system over the network.

If I went with Linux I'd probably do Debian as I'm more familiar with it---how challenging is it to set up the software RAID?

I'm also investigating WS.
 

Mindweaver

Moderato®™
Staff member
Joined
Apr 16, 2009
Messages
8,193 (1.50/day)
Location
Charleston, SC
System Name Tower of Power / Sechs
Processor i7 14700K / i7 5820k @ 4.5ghz
Motherboard ASUS ROG Strix Z690-A Gaming WiFi D4 / X99S GAMING 7
Cooling CM MasterLiquid ML360 Mirror ARGB Close-Loop AIO / CORSAIR Hydro Series H100i Extreme
Memory CORSAIR Vengeance LPX 32GB (2 x 16GB) DDR4 3600 / G.Skill DDR4 2800 16GB 4x4GB
Video Card(s) ASUS TUF Gaming GeForce RTX 4070 Ti / ASUS TUF Gaming GeForce RTX 3070 V2 OC Edition
Storage 4x Samsung 980 Pro 1TB M.2, 2x Crucial 1TB SSD / Samsung 870 PRO 500GB M.2
Display(s) Samsung 32" Odyssy G5 Gaming 144hz 1440p, ViewSonic 32" 72hz 1440p / 2x ViewSonic 32" 72hz 1440p
Case Phantek "400A" / Phanteks “Enthoo Pro series”
Audio Device(s) Realtek ALC4080 / Azalia Realtek ALC1150
Power Supply Corsair RM Series RM750 / Corsair CXM CX600M
Mouse Glorious Gaming Model D Wireless / Razer DeathAdder Chroma
Keyboard Glorious GMMK with box-white switches / Keychron K6 pro with blue swithes
VR HMD Quest 3 (128gb) + Rift S + HTC Vive + DK1
Software Windows 11 Pro x64 / Windows 10 Pro x64
Benchmark Scores Yes
Set it up and play around with it to see how you like it. If it meets your needs then go with it, but I would play around with it to get comfortable. Just remember to well document your drives and Raid Array setup, and label them. Also, remember that it will take awhile to rebuild the software array. Good luck! :toast:
 
Joined
Aug 24, 2007
Messages
443 (0.07/day)
Location
BY-S36
System Name Bitch / Dogma
Processor 955 BE @ 3.8Gig / 9850 @stock
Video Card(s) 8800 GTX 512 / 4890
Storage 8 x Samsung F2 1.5TB, 8 x Seagate 500s
Display(s) Acer 24 / Dell 24
Case Lian li / Akasa
Software Win server 2008 / Win 7
A couple of things to be mindful of:

If you use motherboard raid it will be almost impossible to move your hard drives with data intact to a new platform. If will also be highly unliky that you will be able to easily migrate/expand your raid in the future. I would therefore recommend a low cost raid card (Adaptec/LSI/etc) which will allow you to move your data from platform to platform.

It would also be worth checking your WD drives for compatibility - the green drives are terrible in a lot of raid setups (a lot of NAS manufacturers have WD green drives on the do not use list).

With regard FTP: I use Filezilla server...it's free, secure (sFTP/TLS) and works.


Ninja edit: For a web server I would suggest Uniform Server (Afaik it is the only WAMP package that is in production mode out of the wrapper). Another really big bonus is - portability, you can run it without any install.
 

Aquinus

Resident Wat-man
Joined
Jan 28, 2012
Messages
13,147 (2.97/day)
Location
Concord, NH, USA
System Name Apollo
Processor Intel Core i9 9880H
Motherboard Some proprietary Apple thing.
Memory 64GB DDR4-2667
Video Card(s) AMD Radeon Pro 5600M, 8GB HBM2
Storage 1TB Apple NVMe, 4TB External
Display(s) Laptop @ 3072x1920 + 2x LG 5k Ultrafine TB3 displays
Case MacBook Pro (16", 2019)
Audio Device(s) AirPods Pro, Sennheiser HD 380s w/ FIIO Alpen 2, or Logitech 2.1 Speakers
Power Supply 96w Power Adapter
Mouse Logitech MX Master 3
Keyboard Logitech G915, GL Clicky
Software MacOS 12.1
f you use motherboard raid it will be almost impossible to move your hard drives with data intact to a new platform. If will also be highly unliky that you will be able to easily migrate/expand your raid in the future. I would therefore recommend a low cost raid card (Adaptec/LSI/etc) which will allow you to move your data from platform to platform.

That depends on how he does it. Intel RST(e) will let you move an array between 6-series and 7-series boards. For example, if I put my RAID-5 in a z77 board, I'm pretty sure once SATA is configured for RAID, it would read the configuration from the drives. This is really only true if you're making a big change like Intel to AMD or a 900-series intel chipset to a 7-series chipset or something like that. The same goes for hardware raid cards as well, like cards will still detect the RAID. I also happen to know that RSTe handles RAID fairly well and that expanding RAID-5 is fairly easy and you can even do it while the system is up iirc.

It would also be worth checking your WD drives for compatibility - the green drives are terrible in a lot of raid setups (a lot of NAS manufacturers have WD green drives on the do not use list).

Because of lack of TLER, but that's an issue with newer WD blacks too, but I've run into practically no issues with them ever since I disabled patrol read.

Ninja edit: For a web server I would suggest Uniform Server (Afaik it is the only WAMP package that is in production mode out of the wrapper). Another really big bonus is - portability, you can run it without any install.

I don't know, I recommend nginx because it is event based, very responsive, uses very little CPU, and has an incredibly small memory footprint. Nginx also excels at static content which is what the OP is looking at serving up. That's just me though.

Set it up and play around with it to see how you like it. If it meets your needs then go with it, but I would play around with it to get comfortable. Just remember to well document your drives and Raid Array setup, and label them. Also, remember that it will take awhile to rebuild the software array. Good luck! :toast:
Speak for yourself, my 3x1TB drives rebuild in just a few hours or so using X79. Back when I was using an nForce4 for RAID, it would take twice as long so it really depends on how you do implement said RAID.

If you can go for it, a dedicated RAID card with a BBU is ideal, but fake raid isn't too bad depending on the board. You can enable write-caching with RST/RSTe but you'll really want the server to be connected to a UPS. Also RAID-5 performance isn't all that bad, more often than not it can saturate 1Gbps which is all you really need, even using software or some form of FakeRAID.

I agree with Aquinus and say go with a RAID-5 setup, but only if you are going to use a hardware RAID with a BBU, and not Software (I think Aquinus and shovenose would agree).

I wouldn't say a BBU is required for RAID-5. If you don't enable write caching then there is no point of having it in the first place. This sounds like it will be mostly storage so write speed doesn't have to be perfect, just good enough. Reliability seems to be paramount and a BBU won't offer that unless write caching is enabled. With all of this said, I would opt for a BBU if it's feasible though but I wouldn't bend over backwards for it.
 
Last edited:

Mindweaver

Moderato®™
Staff member
Joined
Apr 16, 2009
Messages
8,193 (1.50/day)
Location
Charleston, SC
System Name Tower of Power / Sechs
Processor i7 14700K / i7 5820k @ 4.5ghz
Motherboard ASUS ROG Strix Z690-A Gaming WiFi D4 / X99S GAMING 7
Cooling CM MasterLiquid ML360 Mirror ARGB Close-Loop AIO / CORSAIR Hydro Series H100i Extreme
Memory CORSAIR Vengeance LPX 32GB (2 x 16GB) DDR4 3600 / G.Skill DDR4 2800 16GB 4x4GB
Video Card(s) ASUS TUF Gaming GeForce RTX 4070 Ti / ASUS TUF Gaming GeForce RTX 3070 V2 OC Edition
Storage 4x Samsung 980 Pro 1TB M.2, 2x Crucial 1TB SSD / Samsung 870 PRO 500GB M.2
Display(s) Samsung 32" Odyssy G5 Gaming 144hz 1440p, ViewSonic 32" 72hz 1440p / 2x ViewSonic 32" 72hz 1440p
Case Phantek "400A" / Phanteks “Enthoo Pro series”
Audio Device(s) Realtek ALC4080 / Azalia Realtek ALC1150
Power Supply Corsair RM Series RM750 / Corsair CXM CX600M
Mouse Glorious Gaming Model D Wireless / Razer DeathAdder Chroma
Keyboard Glorious GMMK with box-white switches / Keychron K6 pro with blue swithes
VR HMD Quest 3 (128gb) + Rift S + HTC Vive + DK1
Software Windows 11 Pro x64 / Windows 10 Pro x64
Benchmark Scores Yes
I'm glad you agree with me Aquinus and just to add I never said you had to use a BBU.. I even explained the difference. Also, remember that to some a few hours is awhile. ;) I should have stated that a Software RAID rebuild will be slower than a Hardware Raid rebuild. :p
 

Aquinus

Resident Wat-man
Joined
Jan 28, 2012
Messages
13,147 (2.97/day)
Location
Concord, NH, USA
System Name Apollo
Processor Intel Core i9 9880H
Motherboard Some proprietary Apple thing.
Memory 64GB DDR4-2667
Video Card(s) AMD Radeon Pro 5600M, 8GB HBM2
Storage 1TB Apple NVMe, 4TB External
Display(s) Laptop @ 3072x1920 + 2x LG 5k Ultrafine TB3 displays
Case MacBook Pro (16", 2019)
Audio Device(s) AirPods Pro, Sennheiser HD 380s w/ FIIO Alpen 2, or Logitech 2.1 Speakers
Power Supply 96w Power Adapter
Mouse Logitech MX Master 3
Keyboard Logitech G915, GL Clicky
Software MacOS 12.1
I'm glad you agree with me Aquinus and just to add I never said you had to use a BBU.. I even explained the difference.

I know, I'm just making that clear. BBUs are overrated IMHO, but that's my own personal opinion. It is better to use one if you can.

Also, remember that to some a few hours is awhile.

It really depends on the controller. I have an LSI controller on a server at work that took several hours to rebuild a 500Gb drive on RAID-6 and those are Constellation ES drives, by no means slow or unreliable. I think the simple fact that you can use the RAID array while it's degraded makes the time to rebuild a much smaller factor. For my RAID-5 I have mostly music, video, pictures, files, and a couple games on it as well as a couple VM images. Generally speaking, even when it's degraded and rebuilding, the performance will still let me do everything I normally do without any degradation of my experience and this is on the same machine as the RAID and that experience will remain the same between RAID 1 and RAID 5. So from a user perspective, the real consideration is capacity, which is why I would opt for RAID 5.

Ion: Does the board have any options for fake raid? (Setting SATA to RAID mode.) I really would discourage software RAID if at all possible. I think that will be a mutual consensus.
 

newtekie1

Semi-Retired Folder
Joined
Nov 22, 2005
Messages
28,472 (4.25/day)
Location
Indiana, USA
Processor Intel Core i7 10850K@5.2GHz
Motherboard AsRock Z470 Taichi
Cooling Corsair H115i Pro w/ Noctua NF-A14 Fans
Memory 32GB DDR4-3600
Video Card(s) RTX 2070 Super
Storage 500GB SX8200 Pro + 8TB with 1TB SSD Cache
Display(s) Acer Nitro VG280K 4K 28"
Case Fractal Design Define S
Audio Device(s) Onboard is good enough for me
Power Supply eVGA SuperNOVA 1000w G3
Software Windows 10 Pro x64
If you have a UPS, and you should, a BBU is pointless. You can still safely enable Write-Back cache with a UPS.

I'd avoid software RAID as well. I'd buy a dedicated RAID card, an inexpensive one though. Something like this: HighPoint RocketRAID 640L Controller Card - Neweg...

Before anyone says it, I know this isn't a true hardware RAID card, it is actually firmware RAID but it is a hell of a lot better than software RAID. The CPU still does the bulk of the work, the RAID card just issues the commands and houses the RAID configuration settings, but it is still way better than doing software RAID in the OS.

Now, speaking of OS. I see no reason that any of what you want to do can't be done with Windows 7 Pro, so that is what I'd go with. Remote admin is provided by remote desktop, Apache gives you a webserver, filezilla gives you a FTP server. That is really all you need.
 

Aquinus

Resident Wat-man
Joined
Jan 28, 2012
Messages
13,147 (2.97/day)
Location
Concord, NH, USA
System Name Apollo
Processor Intel Core i9 9880H
Motherboard Some proprietary Apple thing.
Memory 64GB DDR4-2667
Video Card(s) AMD Radeon Pro 5600M, 8GB HBM2
Storage 1TB Apple NVMe, 4TB External
Display(s) Laptop @ 3072x1920 + 2x LG 5k Ultrafine TB3 displays
Case MacBook Pro (16", 2019)
Audio Device(s) AirPods Pro, Sennheiser HD 380s w/ FIIO Alpen 2, or Logitech 2.1 Speakers
Power Supply 96w Power Adapter
Mouse Logitech MX Master 3
Keyboard Logitech G915, GL Clicky
Software MacOS 12.1
I see no reason that any of what you want to do can't be done with Windows 7 Pro, so that is what I'd go with.

I just would hate recommending using up a Windows 7 key for just this. Debian is more than enough for this and you don't need to burn up a 7 key to do it. Worse comes to worse, if Debian doesn't feel like the right fit he can fall back on Windows. I would strongly recommend giving a *nix distro a try first though.
 

newtekie1

Semi-Retired Folder
Joined
Nov 22, 2005
Messages
28,472 (4.25/day)
Location
Indiana, USA
Processor Intel Core i7 10850K@5.2GHz
Motherboard AsRock Z470 Taichi
Cooling Corsair H115i Pro w/ Noctua NF-A14 Fans
Memory 32GB DDR4-3600
Video Card(s) RTX 2070 Super
Storage 500GB SX8200 Pro + 8TB with 1TB SSD Cache
Display(s) Acer Nitro VG280K 4K 28"
Case Fractal Design Define S
Audio Device(s) Onboard is good enough for me
Power Supply eVGA SuperNOVA 1000w G3
Software Windows 10 Pro x64
I just would hate recommending using up a Windows 7 key for just this. Debian is more than enough for this and you don't need to burn up a 7 key to do it. Worse comes to worse, if Debian doesn't feel like the right fit he can fall back on Windows. I would strongly recommend giving a *nix distro a try first though.

Why not? He says he gets them for free from his school, so why not use it?
 

[Ion]

WCG Team Assistant
Joined
Sep 15, 2009
Messages
13,391 (2.53/day)
Location
Raleigh, North Carolina, United States
System Name Niedersachsen / Ribe / Minsk
Processor i3 3240 / i7-3520M / 4x Opteron 6376 @ 2.86GHz
Motherboard BIOSTAR H61M / HP Q77 / Supermicro H8QG7
Cooling Stock / Stock / 4x 1U G34
Memory 1x8GB / 2x4GB / 4x4GB
Video Card(s) GTX260 / Intel HD 4000 / nVidia GT310
Storage 80GB Intel SSD / 256GB Intel SSD / 2x 60GB SSD (RAID1)
Display(s) Dell 3007 + HP 2245w / 12.1" 1366x768 / None
Case Antec NSK3480 / HP / Supermicro 1U
Audio Device(s) Onboard
Power Supply Enermax 500W / HP 130W / Supermicro Gold 1400W
Keyboard IBM Model M
Software Windows 7 (Niedersachsen/Ribe) / Linux Mint 17.2 (Minsk)
I know, I'm just making that clear. BBUs are overrated IMHO, but that's my own personal opinion. It is better to use one if you can.



It really depends on the controller. I have an LSI controller on a server at work that took several hours to rebuild a 500Gb drive on RAID-6 and those are Constellation ES drives, by no means slow or unreliable. I think the simple fact that you can use the RAID array while it's degraded makes the time to rebuild a much smaller factor. For my RAID-5 I have mostly music, video, pictures, files, and a couple games on it as well as a couple VM images. Generally speaking, even when it's degraded and rebuilding, the performance will still let me do everything I normally do without any degradation of my experience and this is on the same machine as the RAID and that experience will remain the same between RAID 1 and RAID 5. So from a user perspective, the real consideration is capacity, which is why I would opt for RAID 5.

Ion: Does the board have any options for fake raid? (Setting SATA to RAID mode.) I really would discourage software RAID if at all possible. I think that will be a mutual consensus.
If it takes a few hours to build that's fine by me. Realistically, none of the stuff that is going to be stored on here is mission-critical anyways--all of my important school and work files are continually backed up. This is all going to be stuff that is just for fun and could always be re-downloaded/re-ripped if it absolutely came to it.

I expect to be using a Gigabyte P35-UD3R, which has the Intel ICH9R South Bridge that supports RAID 0/1/5/10. However, I don't actually have it yet, so I can't guarantee that's what I'll be using.
If you have a UPS, and you should, a BBU is pointless. You can still safely enable Write-Back cache with a UPS.

I'd avoid software RAID as well. I'd buy a dedicated RAID card, an inexpensive one though. Something like this: HighPoint RocketRAID 640L Controller Card - Neweg...

Before anyone says it, I know this isn't a true hardware RAID card, it is actually firmware RAID but it is a hell of a lot better than software RAID. The CPU still does the bulk of the work, the RAID card just issues the commands and houses the RAID configuration settings, but it is still way better than doing software RAID in the OS.

Now, speaking of OS. I see no reason that any of what you want to do can't be done with Windows 7 Pro, so that is what I'd go with. Remote admin is provided by remote desktop, Apache gives you a webserver, filezilla gives you a FTP server. That is really all you need.
I would love to be able to stream .mkv files through a web browser---with a sufficiently fast internet connection and VLC on the target system, would Apache let me do that?

Would that RAID card that you linked be any better than using the ICH9R to do RAID5? And how key is a UPS? The power at school has proven quite stable so far...
I just would hate recommending using up a Windows 7 key for just this. Debian is more than enough for this and you don't need to burn up a 7 key to do it. Worse comes to worse, if Debian doesn't feel like the right fit he can fall back on Windows. I would strongly recommend giving a *nix distro a try first though.

I do get Windows licenses for free through the engineering department here. I am open to trying Debian though.
 

newtekie1

Semi-Retired Folder
Joined
Nov 22, 2005
Messages
28,472 (4.25/day)
Location
Indiana, USA
Processor Intel Core i7 10850K@5.2GHz
Motherboard AsRock Z470 Taichi
Cooling Corsair H115i Pro w/ Noctua NF-A14 Fans
Memory 32GB DDR4-3600
Video Card(s) RTX 2070 Super
Storage 500GB SX8200 Pro + 8TB with 1TB SSD Cache
Display(s) Acer Nitro VG280K 4K 28"
Case Fractal Design Define S
Audio Device(s) Onboard is good enough for me
Power Supply eVGA SuperNOVA 1000w G3
Software Windows 10 Pro x64
I would love to be able to stream .mkv files through a web browser---with a sufficiently fast internet connection and VLC on the target system, would Apache let me do that?

Would that RAID card that you linked be any better than using the ICH9R to do RAID5? And how key is a UPS? The power at school has proven quite stable so far...

Apache wouldn't allow you to do that directly. Apache is just a web server, you have to build the website yourself. Though if that is all you want the webserver for forget about apache. Use something like Twonky Media Server, not free but very cheap. I use that to stream media through a web browser, no need for VLC at all. Though you'll need a pretty beefy internet connection to stream HD mkv files. For those it would probably just be better to download the file via FTP before playing. If they are SD it shouldn't be as much of an issue, but you'll still need a decent connection. Obviously being on a school connection you probably have a decent connection, but you'll need 20Mb/s+ upload to stream HD content, and that is just one stream.

Other than the SATA 6Gb/s ports there really wouldn't be much advantage over the ICH9R, they are both "firmware" RAID, though I prefer an actual card over using the onboard simply because it is much easier to move to another machine if the motherboard has an issue.

A UPS isn't necessary, especially if you don't use Write-Back cache, but I'd still recommend one. And with basic ones starting at $40 it only makes sense to have one. Though if you have to skip it initially due to financial constraints it isn't going to kill you, but I'd pick one up eventually.
 
Joined
Nov 16, 2007
Messages
1,166 (0.20/day)
Location
Hampton Roads
Processor Xeon x5650
Motherboard SABERTOOTH X58
Cooling Fans
Memory 24 GB Kingston HyperX 1600
Video Card(s) GTX 1060 3GB
Storage small ssd
Display(s) Dell 2001F, BenQ short throw
Case Lian Li
Audio Device(s) onboard
Power Supply X750
Software Mint 19.3, Win 10
Benchmark Scores not so fast...
http://www.rejetto.com/hfs/

So easy...I use it to stream to my phone, my wife's laptop, my tablet (1080p). Open browser, copy link ( it is set up like a FTP), paste into VLC, or whatever, enjoy.

To get to it from outside my network, No-IP handles the routing. All free. I just checked, HFS will run on WINE.
 

Aquinus

Resident Wat-man
Joined
Jan 28, 2012
Messages
13,147 (2.97/day)
Location
Concord, NH, USA
System Name Apollo
Processor Intel Core i9 9880H
Motherboard Some proprietary Apple thing.
Memory 64GB DDR4-2667
Video Card(s) AMD Radeon Pro 5600M, 8GB HBM2
Storage 1TB Apple NVMe, 4TB External
Display(s) Laptop @ 3072x1920 + 2x LG 5k Ultrafine TB3 displays
Case MacBook Pro (16", 2019)
Audio Device(s) AirPods Pro, Sennheiser HD 380s w/ FIIO Alpen 2, or Logitech 2.1 Speakers
Power Supply 96w Power Adapter
Mouse Logitech MX Master 3
Keyboard Logitech G915, GL Clicky
Software MacOS 12.1
I would love to be able to stream .mkv files through a web browser---with a sufficiently fast internet connection and VLC on the target system, would Apache let me do that?

On your local network? iSCSI is always an option and would behave much more like a drive that was physically connected to your computer. If you're outside on the internet you could do some weird SSH forwarding magic to get iSCSI over the internet. I don't think it would be very fast though. I don't have a whole lot of experience with streaming content over the web. I usually only work on a local network when it comes to stuff like that.
 
Last edited:

[Ion]

WCG Team Assistant
Joined
Sep 15, 2009
Messages
13,391 (2.53/day)
Location
Raleigh, North Carolina, United States
System Name Niedersachsen / Ribe / Minsk
Processor i3 3240 / i7-3520M / 4x Opteron 6376 @ 2.86GHz
Motherboard BIOSTAR H61M / HP Q77 / Supermicro H8QG7
Cooling Stock / Stock / 4x 1U G34
Memory 1x8GB / 2x4GB / 4x4GB
Video Card(s) GTX260 / Intel HD 4000 / nVidia GT310
Storage 80GB Intel SSD / 256GB Intel SSD / 2x 60GB SSD (RAID1)
Display(s) Dell 3007 + HP 2245w / 12.1" 1366x768 / None
Case Antec NSK3480 / HP / Supermicro 1U
Audio Device(s) Onboard
Power Supply Enermax 500W / HP 130W / Supermicro Gold 1400W
Keyboard IBM Model M
Software Windows 7 (Niedersachsen/Ribe) / Linux Mint 17.2 (Minsk)
Apache wouldn't allow you to do that directly. Apache is just a web server, you have to build the website yourself. Though if that is all you want the webserver for forget about apache. Use something like Twonky Media Server, not free but very cheap. I use that to stream media through a web browser, no need for VLC at all. Though you'll need a pretty beefy internet connection to stream HD mkv files. For those it would probably just be better to download the file via FTP before playing. If they are SD it shouldn't be as much of an issue, but you'll still need a decent connection. Obviously being on a school connection you probably have a decent connection, but you'll need 20Mb/s+ upload to stream HD content, and that is just one stream.

Other than the SATA 6Gb/s ports there really wouldn't be much advantage over the ICH9R, they are both "firmware" RAID, though I prefer an actual card over using the onboard simply because it is much easier to move to another machine if the motherboard has an issue.

A UPS isn't necessary, especially if you don't use Write-Back cache, but I'd still recommend one. And with basic ones starting at $40 it only makes sense to have one. Though if you have to skip it initially due to financial constraints it isn't going to kill you, but I'd pick one up eventually.
Oh, I'm aware that Apache wouldn't let me do that directly--I can probably find instructions or a pre-made thing on how to get the streaming working.

The HD TV shows I have are about 1.4 gigabytes per 40 minute episode, which comes out to about .58 megabytes/second. I can consistently get twice that uploading from the dorm, so I assume that this would be feasible?

I'll try to get a UPS at some point--at $40 that seems very reasonable.
http://www.rejetto.com/hfs/

So easy...I use it to stream to my phone, my wife's laptop, my tablet (1080p). Open browser, copy link ( it is set up like a FTP), paste into VLC, or whatever, enjoy.

To get to it from outside my network, No-IP handles the routing. All free. I just checked, HFS will run on WINE.
We have a static IP at school, so that's easy. I can just memorize it easily. I'll check out HFS--I think that I've seen it before :)
On your local network? iSCSI is always an option and would behave much more like a drive that was physically connected to your computer. If you're outside on the internet you could do some weird SSH forwarding magic to get iSCSI over the internet. I don't think it would be very fast though. I don't have a whole lot of experience with streaming content over the web. I usually only work on a local network when it comes to stuff like that.

I am entirely unfamiliar with iSCSI--I'll check it out though! The goal would be to stream to another system on the same network or another hall on campus (so across a consistently very fast network).

Thanks for the help everyone! :toast:
 

Aquinus

Resident Wat-man
Joined
Jan 28, 2012
Messages
13,147 (2.97/day)
Location
Concord, NH, USA
System Name Apollo
Processor Intel Core i9 9880H
Motherboard Some proprietary Apple thing.
Memory 64GB DDR4-2667
Video Card(s) AMD Radeon Pro 5600M, 8GB HBM2
Storage 1TB Apple NVMe, 4TB External
Display(s) Laptop @ 3072x1920 + 2x LG 5k Ultrafine TB3 displays
Case MacBook Pro (16", 2019)
Audio Device(s) AirPods Pro, Sennheiser HD 380s w/ FIIO Alpen 2, or Logitech 2.1 Speakers
Power Supply 96w Power Adapter
Mouse Logitech MX Master 3
Keyboard Logitech G915, GL Clicky
Software MacOS 12.1
I am entirely unfamiliar with iSCSI--I'll check it out though! The goal would be to stream to another system on the same network or another hall on campus (so across a consistently very fast network).

Oh man! You have no idea what you're missing then. iSCSI sends SCSI commands over an IP network, so you're basically accessing files directly on the iSCSI target over a network. Think of it this way. Streaming will work because you're accessing the file over the network directly as if it were a file locally on the machine you're using. It's like a mapped network drive but better. It's not incredibly easy to configure though. This would be best if your machines are connecting to your server only.

If other people will be connecting to it you will want to use something like Samba. Just about every machine likes Samba and since this is a "local" network it should work well. So in the name of simplicity and that mapping network drives works well (on OS X and Windows,) I would say, go with Samba. :cool:

( All of this is doable in Debian. ;) )
 
Top