Comino GRANDO RM-S Liquid-Cooled Multi-GPU Workstation Review - €37,000 Computer Tested 12

Comino GRANDO RM-S Liquid-Cooled Multi-GPU Workstation Review - €37,000 Computer Tested

(12 Comments) »

Introduction

Comino Logo

Comino launched in 2017 and has since sold over 2000 workstations with the common theme of liquid cooling as a focus, and its own custom cooling controllers help run these systems. We first had a look at the brand at Computex 2019 with the unique Comino Otto SFF chassis and Comino-designed CPU and GPU water blocks manufactured with space and cooling efficiency in mind. A fully built Otto system also impressed us with its innovative cooling, which combined the best of aftermarket heat dissipation from Hardware Labs with custom cold plates to make for lots of gaming and compute power packed into a small 13 L form factor. But the Otto is just one of many Comino ventures, with its bread and butter from the workstation and server world. Take the GRANDO Forensic series, for example, which is custom built with data decryption and password recovery in mind. This leads us to the more general use case of customizable hardware for heavy prosumer and professional user loads, and we take a look at Comino's GRANDO RM line today.


While the Otto is intended for home users and the GRANDO Forensic for data recovery, the Comino GRANDO RM line does not discriminate given the highly customizable nature of the lineup. There are at this time two platforms, the GRANDO RM V2-L and RM V2-S, where the L and S stand for Long and Short, and I will just refer to them as the GRANDO RM-L and RM-S for convenience. The RM-L allows for more cooling and supports more hardware too, with the appeal targeting data scientists, graphics developers, game rendering, or simply servers. The common theme remains liquid cooling, which is why you are seeing me cover the system. The GRANDO RM-S we will be taking a look at today is inherently limited by physical space but still manages to pack a big punch to challenge even some compute clusters, as I found out. Comino loaned TechPowerUp a custom-built version of the GRANDO RM-S that goes beyond the usual offerings with an AMD Ryzen Threadripper PRO 3995WX processor and four NVIDIA RTX A6000 GPUs, which is easily the most powerful system I have ever laid my hands on, too. Thanks to Comino for providing TechPowerUp this opportunity!

Specifications of the Provided Comino GRANDO RM-S System
Manufacturer:Comino
Model:GRANDO RM V2-S
Chassis:Custom Comino server rack case
Processor:AMD Ryzen Threadripper PRO 3995WX
64 cores, 128 threads
2.7 GHz base (4.2 GHz Boost)
Cooling:Full system liquid-cooling loop
Comino GPU WCB for NVIDIA RTX A6000, Cu-Steel (x4)
Comino CPU WCB for AMD Ryzen Threadripper PRO 3995WX, Cu-Steel
Motherboard:AMD WRX80
ASUS Pro WS WRX80E-SAGE SE WIFI
Operating System:Windows 10 Professional 64-bit + Ubuntu
Dedicated Graphics:NVIDIA RTX A6000 (x4)
48 GB ECC GDDR6
4x DisplayPort 1.4
PCIe Gen 4x16
Memory:32 GB Gigabyte ECC DDR4 (x8)
Cl 20-19-19-43 @ 2600 MHz
Storage:AORUS 2 TB NVMe Gen 4 M.2 SSD
Samsung 7.68TB PM1733 2.5" U.2 Enterprise SSD
Power:Comino Energy 750W SFX Platinum (x3)
Warranty:1–5 years
MSRP:€37,000 (incl. VAT) as tested

Packaging and Accessories


I realize that most of our readers are not in the market for an über-expensive system clearly meant for professional use; however, Comino's goal here was to show the scalable platforms the GRANDO RM-S and RM-L are. The liquid-cooling aspect was of personal interest, and it was all the more piqued when a freight truck stopped by to drop off a ~55 kg pallet that had a large wooden crate and the longer, separate box seen above. I will spare you the unboxing experience since it's not very photogenic, especially when done by a single person struggling through the experience even though Comino makes it easy with six long Phillips-head screws securing the lid of the wooden crate. The system is in a thick foam compartment with the various accessories in side cutouts, and a product manual on top is the first thing you'll see and read.


The product manual is comprised of two double-sided sheets printed on thick glossy paper placed inside a clear folder, with the first being a quick start guide (online copy here) that walks you through the startup, monitoring, and shutdown sequences of the system using the Comino two-button and display controller setup. It also mentions heading over to this page for customer support and further technical documentation, including a much more detailed user manualremote monitoring utility, and the warranty terms. The second sheet is effectively a specification sheet that also acts as a quality check and assurance summary, and we then get to all the piled up accessories. Many of these are add-ons for individual components in the GRANDO RM-S, such as the ASUS WiFi antenna and add-in M.2 adapter that come with the motherboard, or the installation hardware for the optional handles on the back and front of the chassis if sliding this into a 4U slot in a server rack. The only items I used were the three power cords, and all three have the UK plug for my region with an integrated fuse. The small USB drive provided by Comino contains the various drivers for the used hardware.


The handles on the back are for a full Supermicro rail kit contained in the other box that arrived on top of the wooden crate, and the user manual describes the installation process. Given I only have this system for a limited period of time and don't have server racks at my place, I chose not to go through the kit. The photo is just to show that it does ship with the GRANDO RM-S, which in turn comes heavily wrapped for further protection in transit.

Closer Look


The Comino GRANDO RM-S in the test configuration is a hefty beast, and lifting it onto my photography table was no easy feat. It comes in at 442 x 619 x 177 mm without any handles attached and weighs nearly 30 kg. After I had removed all the plastic wrap, I started a closer examination of the system with what I thought was the front, but is clearly the rear. There are two sections to this panel, with the larger of the two having large honeycomb cutouts for airflow to the 360 mm (triple 120 mm) radiator seen right away. This is a multi-port radiator with two spare ports at the top closed via hex head stop plugs, and these can be used down the line to drain, fill, or top off the loop, although Comino uses the reservoir for the filling. Comino's implementation of the pre-assembled system means customer won't have do so for a long time. There's a temperature sensor (air exhaust) just past the radiator, too. Labels on the bottom confirm the product name and have the serial number in and relevant OS credentials. The smaller section gives access to plug the three power chords into the three Comino-branded 750 W SFX 80+ Platinum PSUs, and you need to route the cable through a relatively thin cutout before turning on the switches on each power supply. The SFX form factor saves space, and Comino justifies the use of three 750 W PSUs as opposed to two 1000+ W PSUs or otherwise by stating that the goal was to have all three units operate at 50–70% load, the sweet spot for operating efficiency.


There's not a whole lot to see on the sides, which in the horizontal server rack orientation become the top and bottom panels. These are held in place with multiple hex screws which may be removed to access the internals we shall soon see. It is really the other side that is of primary interest—it is the de-factor front of the GRANDO RM-S.


On the top—or left outside of the vertical workstation orientation—is the reservoir with a see-through panel. We see coolant along with the deliberate air gap to account for any pressure changes in the loop during operation. Comino rates an operating temperature range of 3–38 °C for the system and a storage temperature range of -5–50 °C, which points towards an industrial-class coolant with anti-freeze. Of interest are also the two vandal switches with ring LEDs, and these are multi-purpose buttons that not only power on and shut down the system, but also act as navigation keys for the LCD display alongside. These are two pieces of a larger control and monitoring system built into the GRANDO RM-S, with the actual controller behind the reservoir on the inside. More of the honeycomb cutouts are on the thick metal panels, which provide a sneak peek at the hardware inside, including the various other temperature sensors. The motherboard I/O is next, with the ASUS Pro WS WRX80E-SAGE SE WIFI providing plenty of connectivity options, including WiFi-6, dual 10 GigE ports, plenty of USB Type-A and Type-C superspeed ports, and a multi-channel audio configuration for your speakers, source, headphones, and headset. Rounding off this view are the various video outputs from the integrated graphics card (VGA only) and four DisplayPort 1.4 ports per NVIDIA RTX A6000 GPU. No Type-C or HDMI here for those thinking of driving a VR development platform and testing native hardware, although a configuration for actual development would typically include test kits with other I/O options anyway.


With one of the solid panels removed, we get a much better view of the components inside, which confirms some of the used cooling components, including a single Alphacool NexXxos UT60 360 mm radiator for all the water blocks here. This is an off-the-shelf part with decent performance, although long in the tooth and supplanted by many in the same or lower thickness class. Perhaps Comino got a good deal moving from Hardware Labs in the Otto to Alphacool here, and it is still a very decent radiator in practice. It could also be a case of the components having been finalized a while ago, with Comino having validated it in the GRANDO RM-S and chosen not to update the system base. Two custom-designed stainless steel barb fittings connect flexible silicone tubing to and from the radiator. Notice that no fans are directly mounted to the radiator. In fact, doing so would have obstructed airflow to the PSUs slightly. Comino's compromise consists of three Noctua NF-A14 iPPC 3000 RPM 140 mm fans placed further into the chassis to create an intake airfield from the front and out through the radiator in the back. How well this works in practice remains to be seen, but Comino says it was done to use 140 mm fans for radiator and chassis cooling while making the most of the 4U width that can only fit a 120 mm radiator. The irregular placement of all the hardware means there is direct, unobstructed airflow from the fans to the air-cooled components too, which makes this an interesting design.


Comino has a short video showing how its custom water blocks are designed and manufactured. It ells us the CPU and GPU blocks are passivated copper-based, CNC-machined in what Comino calls a patented "deformational cutting" method to increase the contact and microfin surface area for improved heat transfer. The example GPU block in that video certainly has way more microfins over a much larger area than your average consumer product from the likes of EK and CORSAIR, and the GRANDO RM-S has five water blocks in total on the CPU and the four GPUs. Comino says the microfins are 250 µm thick with slimmer channels in between, and 2.7 mm high. The cold plate directly touches the core and VRMs too, which is nice. The passivated stainless steel and G1/4" threaded Comino custom-designed zero spill quick disconnect fittings also make it fairly simple to swap the CPU and/or GPUs with attached water blocks. These are all low-profile blocks, which is handy with the 1-slot GPU thickness as it has four GPUs fit into the GRANDO RM-S. The controller is behind the high-grade POM reservoir which houses ~450 mL of coolant and has two 18 W pumps for coolant flow throughout this otherwise restrictive loop. Identifying the exact pumps isn't easy, but Comino confirms that two 18 W Xylem DDC pumps in series are used.

Seen above are two videos that show the Comino GRANDO RM-S powered on and in standby, and with the system turned on. The display and controller work with temperature sensors, and the pumps and fans are connected to the controller for separately powered and monitored cooling outside of whether the motherboard is on or not. This decoupled cooling turns it on before the system for a check of all the components necessary to keep the CPU and GPUs running smoothly, and continues to run for a few minutes after the system is shut down, too. The video also gives an indication of ambient noise, which is a continuous gurgle in the 32 dB vicinity from a meter away, and the semi-open panels are what keeps it slightly louder than it would be in a more closed PC case. There are no coolant flow meters though, although the controller clearly handles it as seen in the idle monitoring scenario, with the various relevant metrics on screen.
Our Patreon Silver Supporters can read articles in single-page format.
Discuss(12 Comments)
Apr 19th, 2024 06:56 EDT change timezone

New Forum Posts

Popular Reviews

Controversial News Posts