• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

NVIDIA Omniverse Expands Worlds Using Apple Vision Pro

GFreeman

News Editor
Staff member
Joined
Mar 6, 2023
Messages
1,483 (2.45/day)
NVIDIA is bringing OpenUSD-based Omniverse enterprise digital twins to the Apple Vision Pro. Announced today at NVIDIA GTC, a new software framework built on Omniverse Cloud APIs, or application programming interfaces, lets developers easily send their Universal Scene Description (OpenUSD) industrial scenes from their content creation applications to the NVIDIA Graphics Delivery Network (GDN), a global network of graphics-ready data centers that can stream advanced 3D experiences to Apple Vision Pro.

In a demo unveiled at the global AI conference, NVIDIA presented an interactive, physically accurate digital twin of a car streamed in full fidelity to Apple Vision Pro's high-resolution displays. The demo featured a designer wearing the Vision Pro, using a car configurator application developed by CGI studio Katana on the Omniverse platform. The designer toggles through paint and trim options and even enters the vehicle - leveraging the power of spatial computing by blending 3D photorealistic environments with the physical world.




Bringing the Power of RTX Enterprise Cloud Rendering to Spatial Computing
Spatial computing has emerged as a powerful technology for delivering immersive experiences and seamless interactions between people, products, processes and physical spaces. Industrial enterprise use cases require incredibly high-resolution displays and powerful sensors operating at high frame rates to make manufacturing experiences true to reality.

This new Omniverse-based workflow combines Apple Vision Pro groundbreaking high-resolution displays with NVIDIA's powerful RTX cloud rendering to deliver spatial computing experiences with just the device and an internet connection.

This cloud-based approach allows real-time physically based renderings to be streamed seamlessly to Apple Vision Pro, delivering high-fidelity visuals without compromising details of the massive, engineering fidelity datasets.

"The breakthrough ultra-high-resolution displays of Apple Vision Pro, combined with photorealistic rendering of OpenUSD content streamed from NVIDIA accelerated computing, unlocks an incredible opportunity for the advancement of immersive experiences," said Mike Rockwell, vice president of the Vision Products Group at Apple. "Spatial computing will redefine how designers and developers build captivating digital content, driving a new era of creativity and engagement."

"Apple Vision Pro is the first untethered device which allows for enterprise customers to realize their work without compromise," said Rev Lebaredian, vice president of simulation at NVIDIA. "We look forward to our customers having access to these amazing tools."

The workflow also introduces hybrid rendering, a groundbreaking technique that combines local and remote rendering on the device. Users can render fully interactive experiences in a single application from Apple's native SwiftUI and Reality Kit with the Omniverse RTX Renderer streaming from GDN.

NVIDIA GDN, available in over 130 countries, taps NVIDIA's global cloud-to-edge streaming infrastructure to deliver smooth, high-fidelity, interactive experiences. By moving heavy compute tasks to GDN, users can tackle the most demanding rendering use cases, no matter the size or complexity of the dataset.

Enhancing Spatial Computing Workloads Across Use Cases
The Omniverse-based workflow showed potential for a wide range of use cases. For example, designers could use the technology to see their 3D data in full fidelity, with no loss in quality or model decimation. This means designers can interact with trustworthy simulations that look and behave like the real physical product. This also opens new channels and opportunities for e-commerce experiences.

In industrial settings, factory planners can view and interact with their full engineering factory datasets, letting them optimize their workflows and identify potential bottlenecks.

For developers and independent software vendors, NVIDIA is building the capabilities that would allow them to use the native tools on Apple Vision Pro to seamlessly interact with existing data in their applications.

View at TechPowerUp Main Site | Source
 
Joined
Dec 29, 2023
Messages
13 (0.04/day)
System Name very cable managed
Processor AMD Ryzen 5 7600X
Motherboard MSI Pro B650-S Wifi
Cooling Thermalright Peerless Assassin 120 SE
Memory Lexar Thor 32GiB DDR5-5600 CL36
Video Card(s) Zotac Twin Edge OC Nvidia GeForce RTX 4060
Storage Micron Crucial P3 Plus 1TB
Display(s) Innocn 27G1S, XGaming TMDTMD24S1
Case Zalman S2
Power Supply Thermalright Toughpower GF1 850W
Mouse Logitech Lightspeed G305
Keyboard Rii RK200
Software Windows 11 Pro
Benchmark Scores Geekbench 6: 2941 CPU Single Core, 13105 CPU Multicore, 104198 GPU OpenCL Cinebench R24:GPU:10258
Always nice to see features being added. My happiness is a little strained when I could get multiple 4090s (and likely 5090s as well) for the money I would have to spend to actually use any of this, though.
 

dgianstefani

TPU Proofreader
Staff member
Joined
Dec 29, 2017
Messages
4,989 (2.00/day)
Location
Swansea, Wales
System Name Silent
Processor Ryzen 7800X3D @ 5.15ghz BCLK OC, TG AM5 High Performance Heatspreader
Motherboard ASUS ROG Strix X670E-I, chipset fans replaced with Noctua A14x25 G2
Cooling Optimus Block, HWLabs Copper 240/40 + 240/30, D5/Res, 4x Noctua A12x25, 1x A14G2, Mayhems Ultra Pure
Memory 32 GB Dominator Platinum 6150 MT 26-36-36-48, 56.6ns AIDA, 2050 FCLK, 160 ns tRFC, active cooled
Video Card(s) RTX 3080 Ti Founders Edition, Conductonaut Extreme, 18 W/mK MinusPad Extreme, Corsair XG7 Waterblock
Storage Intel Optane DC P1600X 118 GB, Samsung 990 Pro 2 TB
Display(s) 32" 240 Hz 1440p Samsung G7, 31.5" 165 Hz 1440p LG NanoIPS Ultragear, MX900 dual gas VESA mount
Case Sliger SM570 CNC Aluminium 13-Litre, 3D printed feet, custom front, LINKUP Ultra PCIe 4.0 x16 white
Audio Device(s) Audeze Maxwell Ultraviolet w/upgrade pads & LCD headband, Galaxy Buds 3 Pro, Razer Nommo Pro
Power Supply SF750 Plat, full transparent custom cables, Sentinel Pro 1500 Online Double Conversion UPS w/Noctua
Mouse Razer Viper Pro V2 8 KHz Mercury White w/Tiger Ice Skates & Pulsar Supergrip tape
Keyboard Wooting 60HE+ module, TOFU-R CNC Alu/Brass, SS Prismcaps W+Jellykey, LekkerV2 mod, TLabs Leath/Suede
Software Windows 11 IoT Enterprise LTSC 24H2
Benchmark Scores Legendary
Super cool use of the Vison Pro, AFAIK the main issue with it currently is there's not much content or applications that support it's format, NVIDIA supporting it is huge.
 
Joined
Jul 13, 2016
Messages
3,243 (1.07/day)
Processor Ryzen 7800X3D
Motherboard ASRock X670E Taichi
Cooling Noctua NH-D15 Chromax
Memory 32GB DDR5 6000 CL30
Video Card(s) MSI RTX 4090 Trio
Storage Too much
Display(s) Acer Predator XB3 27" 240 Hz
Case Thermaltake Core X9
Audio Device(s) Topping DX5, DCA Aeon II
Power Supply Seasonic Prime Titanium 850w
Mouse G305
Keyboard Wooting HE60
VR HMD Valve Index
Software Win 10
Super cool use of the Vison Pro, AFAIK the main issue with it currently is there's not much content or applications that support it's format, NVIDIA supporting it is huge.

Low FOV, low refresh rate, motion blur issues, lack of edge to edge clarity, no controllers, and other issues hold the Vision Pro back. It's very clearly an enterprise class HMD, in which case Varjo offers a higher resolution product without many of the drawbacks the Apple HMD has.
 
Joined
Sep 17, 2014
Messages
22,278 (6.02/day)
Location
The Washing Machine
Processor 7800X3D
Motherboard MSI MAG Mortar b650m wifi
Cooling Thermalright Peerless Assassin
Memory 32GB Corsair Vengeance 30CL6000
Video Card(s) ASRock RX7900XT Phantom Gaming
Storage Lexar NM790 4TB + Samsung 850 EVO 1TB + Samsung 980 1TB + Crucial BX100 250GB
Display(s) Gigabyte G34QWC (3440x1440)
Case Lian Li A3 mATX White
Audio Device(s) Harman Kardon AVR137 + 2.1
Power Supply EVGA Supernova G2 750W
Mouse Steelseries Aerox 5
Keyboard Lenovo Thinkpad Trackpoint II
Software W11 IoT Enterprise LTSC
Benchmark Scores Over 9000
Such a hilarious waste of time, this product. Oh man.

Where is the market for this crap? There isn't one for AR or VR to speak of. But Apple's gonna carve out an extra special market here with a sub par HMD. Again: hilarious. Especially if they succeed, which in todays tyranny of stupidity, might even happen.
 

neoMM24

New Member
Joined
Feb 27, 2024
Messages
8 (0.03/day)
So looking at that vod: you'll need a $4k pair of AR glasses, just to order a $200k car... to drive it virtually in a 50 square feet apartment... interesting.
 
Top