Penguin Solutions, Inc., the AI Factory Platform Company, today introduced the SMART CXL-8F2W-D4, an eight-DIMM DDR4 Compute Express Link (CXL) memory add-in card that enables organizations to adapt DDR4 memory for use in AI systems. Using DDR4 as an alternative to newer-generation DDR5 memory provides an innovative approach offering performance, sourcing, and economic benefits for the buildout of AI infrastructure.

According to TechInsights, Inc., AI data centers account for 34% of DRAM demand in 2026, a figure expected to climb to nearly 50% by 2029. This rapid growth is driving up memory costs and putting increasing pressure on infrastructure budgets. For organizations deploying new servers, whether as part of a technology refresh or a new data center buildout, the rising cost of memory presents a significant challenge, underscoring the need for more cost-effective ways to expand memory capacity.

Penguin Solutions, Inc. (Nasdaq: PENG), the AI factory platform company, today announced the industry's first production-ready KV cache server that utilizes CXL memory technology to address the critical "memory wall" challenge in AI inferencing—Penguin Solutions MemoryAI KV cache server. This innovative solution delivers up to 11 TB of CXL-based memory engineered to optimize performance of enterprise scale inference, including agentic AI. The result is lower latency, higher throughput, increased efficiency of GPU clusters, consistent achievement of stringent service-level agreements (SLAs), and faster time-to-first-token (TTFT).

While model training and tuning is primarily compute-bound and occurs episodically, the continuous memory-bound and latency-sensitive inference workloads required for inference and agentic AI are complex and fundamentally different. Inference demands are typically 30% compute driven (GPU) and 70% memory driven (RAM), elevating the need for greater memory capacity and causing performance bottlenecks and GPU idle time. Accelerating memory-dependent AI processes, Penguin's MemoryAI KV cache server increases memory capacity by integrating 3 TB of DDR5 main memory and up to eight 1 TB CXL Add-in Cards (AICs).

Penguin Solutions, Inc. a leading provider of high-performance computing and AI infrastructure solutions, today announced that its SMART Modular CXL NV-CMM E3.S 2T non-volatile memory module has successfully passed CXL compliance testing. This achievement not only signifies adherence to industry standards, but positions Penguin Solutions as a trusted leader in advanced memory technology for CXL applications. Penguin's SMART Modular CXL NV-CMM E3.S 2T Memory Module is now listed on the CXL Consortium's Integrators List.

The CXL NV-CMM E3.S 2T module utilizes the Compute Express Link (CXL) 2.0 standard, offering low latency, high bandwidth persistent storage with enterprise-class RAS features. This module accelerates system performance through efficient checkpointing and caching for in-memory databases, and ensures quick data recovery following power loss or system crashes.