Monday, December 3rd 2018

NVIDIA Presents the TITAN RTX 24GB Graphics Card at $2,499

NVIDIA today introduced NVIDIA TITAN RTX , the world's most powerful desktop GPU, providing massive performance for AI research, data science and creative applications. Driven by the new NVIDIA Turing architecture, TITAN RTX - dubbed T-Rex - delivers 130 teraflops of deep learning performance and 11 GigaRays of ray-tracing performance.

"Turing is NVIDIA's biggest advance in a decade - fusing shaders, ray tracing, and deep learning to reinvent the GPU," said Jensen Huang, founder and CEO of NVIDIA. "The introduction of T-Rex puts Turing within reach of millions of the most demanding PC users - developers, scientists and content creators."
Ultimate PC GPU
NVIDIA's greatest leap since the invention of the CUDA GPU in 2006 and the result of more than 10,000 engineering-years of effort, Turing features new RT Cores to accelerate ray tracing, plus new multi-precision Tensor Cores for AI training and inferencing. These two engines - along with more powerful compute and enhanced rasterization - enable capabilities that will transform the work of millions of developers, designers and artists across multiple industries.
Designed for a variety of computationally demanding applications, TITAN RTX provides an unbeatable combination of AI, real-time ray-traced graphics, next-gen virtual reality and high performance computing. It delivers:
  • 576 multi-precision Turing Tensor Cores, providing up to 130 teraflops of deep learning performance.
  • 72 Turing RT Cores, delivering up to 11 GigaRays per second of real-time ray-tracing performance.
  • 24GB of high-speed GDDR6 memory with 672GB/s of bandwidth - 2x the memory of previous-generation TITAN GPUs - to fit larger models and datasets.
  • 100GB/s NVIDIA NVLink can pair two TITAN RTX GPUs to scale memory and compute.
  • Incredible performance and memory bandwidth for real-time 8K video editing.
  • VirtualLink port provides the performance and connectivity required by next-gen VR headsets.
Built for AI Researchers and Deep Learning Developers
TITAN RTX transforms the PC into a supercomputer for AI researchers and developers. TITAN RTX provides multi-precision Turing Tensor Cores for breakthrough performance from FP32, FP16, INT8 and INT4, allowing faster training and inference of neural networks. It offers twice the memory capacity of previous generation TITAN GPUs, along with NVLink to allow researchers to experiment with larger neural networks and data sets.

Perfect for Data Scientists
A powerful tool for data scientists, TITAN RTX accelerates data analytics with RAPIDS. RAPIDS open-source libraries integrate seamlessly with the world's most popular data science workflows to speed up machine learning.
Content Creators Create Their Best Work
TITAN RTX brings the power of real-time ray tracing and AI to creative applications, so 5 million PC-based creators can iterate faster. It also delivers the computational horsepower and memory bandwidth needed for real-time 8K video editing.
Available This Month
TITAN RTX will be available later this month in the U.S. and Europe for $2,499.
Add your own comment

193 Comments on NVIDIA Presents the TITAN RTX 24GB Graphics Card at $2,499

#51
EarthDog
Vya Domussnip
AMD has always been competitive in the price to performance market, but not so much in that high-end space. I think their $1500 flagship (r9 295x2) was the last thing they had in the high end space... and that was a dual GPU solution using 500W of power. The 8800 Ultra debuted with an MSRP of $829. I suppose 18% off of $1000 is 'nearly' (as in horseshoes, hand grenades, and nuclear war... close enough). The 290x out of the box was 13% slower than a 780 Ti without using its 'uber' mode and 8% with it (according to TPU review of 780Ti). That, IIRC, was about the closest they came in those 10 years.

Competition is in fact one variable which can (but not always) drives prices down (the absolute nature of you words make that passage incorrect). Another variable about pricing is what the market supports (as you said). If there is zero competition at that performance segment and the market supports it.. guess what.... we have pricey cards. But it isn't a case of the chicken or the egg.
unikinI was looking forward to release of Titan RTX hoping to get some cheaper 64-bit double precision math performance out of it and now this: Titan RTX = 0.51 TFLOPS Double Precision FP64, my old Titan V is giving me 6.9 TFLOPS FP64! This is a huge downgrade for anyone doing math modeling. Yet another NVidias' product segmentation. They deliberately crippled double precision performance on Titan RTX. The only current choice remaining for us pro users is Tesla V100 with $10K price tag. I paid $8.5K for triple Titan V GPUs giving me nearly 21 TFLOPS of FP64 and I'd have to pay $30K for 21 FP64 performance now. Where is the logic in that? NVidia has gone completely loco with pricing. When my Titans V die on me I'll go for AMD VEGA Instinct MI60 if price is more normal. If not, I'm f...ed.
What about the DP performance on the RTX Quadros? Are those any different?
Posted on Reply
#52
Konceptz
btarunrNVIDIA's greatest leap since the invention of the CUDA GPU in 2006 and the result of more than 10,000 engineering-years of effort,
Wait, what? 10,000 years!?!?!
Posted on Reply
#53
unikin
EarthDogWhat about the DP performance on the RTX Quadros? Are those any different?
I don't know because they are not out yet. RTX 8000 will have 8 TFLOPs with $10K price tag, maybe RTX 6000 will be an option with the same TFLOPs perf selling for $6.3K on preorders. But we're still talking about 107 % price increase for 12 % more performance. Titan V has been poor mans' Quadro and Nvidia probably doesn't like it, that's why they decided to cripple Titan line.
Posted on Reply
#54
EarthDog
KonceptzWait, what? 10,000 years!?!?!
If there were 10 engineers who put in 1000 hours on the card. Yes. That passage is written properly.
unikinI don't know because they are not out yet. RTX 8000 will have 8 TFLOPs with $10K price tag, maybe RTX 6000 will be an option with the same TFLOPs perf selling for $6.3K on preorders. But we're still talking about 107 % price increase for 12 % more performance. Titan V has been poor mans' Quadro and Nvidia probably doesn't like it, that's why they decided to cripple Titan line.
I'm just wondering about the RTX 5000 for $2300. If that is, say 2 TFLOPS, perhaps it can be a viable option? I don't know.
Posted on Reply
#55
Konceptz
EarthDogIf there were 10 engineers who put in 1000 hours on the card. Yes. That passage is written properly.
LOL I was like huh? I know i'm sleep deprived but....
Posted on Reply
#56
unikin
EarthDogI'm just wondering about the RTX 2000 or w/e for $2300. If that is, say 2 TFLOPS, perhaps it can be a viable option? I don't know.
I need at least 20 TFLOPS per comp for modeling unfortunately and even this is on the slow side when you have client's deadlines to catch. 3 Titans V per computer are OK. We have 17 such PCs in our offices, so I'm looking at $320K instead of $150K investment when Titans start dying.
Posted on Reply
#57
Vayra86
KonceptzWait, what? 10,000 years!?!?!
Yeah that reads like engineering years are dog's years or something :D
Posted on Reply
#58
EarthDog
unikinI need at least 20 TFLOPS per comp for modeling unfortunately and even this is on the slow side when you have client's deadlines to catch. 3 Titans V per computer are OK. We have 17 such PCs in our offices, so I'm looking at $320K instead of $150K investment when Titans start dying.
Further market segmentation FTL. :(

EDIT: That FP64 though... literally is the only place where its slower than the Titan V (right?)...
Posted on Reply
#59
jabbadap
KonceptzWait, what? 10,000 years!?!?!
Well i.e. thousand engineers tackling with the task for ten years makes it 10 000 engineering-years.
Posted on Reply
#60
diatribe
Vayra86Yeah that reads like engineering years are dog's years or something :D
Work Year = ~ 2,080 work hours

10,000 * 2,080
= 10,000 work years
OR
20,800,000 hours.
Posted on Reply
#61
unikin
EarthDogFurther market segmentation FTL. :(

EDIT: That FP64 though... literally is the only place where its slower than the Titan V (right?)...
Yet very important one. Unfortunately the accuracy of double precision compute is a must in precise physics modelling. If you can get away with FP16, FP32 compute precision Titan RTX will be slightly better than Titan V, but as I said most physics simulation&modelling or high accuracy financial computation require capable FP64 GPUs nowdays.

Btw: FP64 : FP32 ratio is very, very low on Titan RTX. Usual ratio lies between 1:2 and 1:3, Titan RTX has abysmal 1:32 ratio almost exactly as 3yo Quadro M6000. One more proof of deliberate market segmentation.
Posted on Reply
#62
Vya Domus
unikinhigh accuracy financial computation require capable FP64 GPUs nowdays.
You'd never ever want to use floating point be it even of double precision for financial applications. Even if you would, CPUs would better serve these types of applications anyway due to the sequential nature of operations that need to be performed.
unikinUnfortunately the accuracy of double precision compute is a must in precise physics modelling.
For some, sure, but most of the time you can get away with FP32 if you are careful enough to craft numerically stable algorithms. DP simply hasn't been of great focus, after all it was only with the development of Kepler and GCN that this features was even added.
Posted on Reply
#63
unikin
Vya DomusYou'd never ever want to use floating point be it even of double precision for financial applications. Even if you would, CPUs would better serve these types of applications anyway due to the sequential nature of operations that need to be performed.

For some, sure, but most of the time you can get away with FP32 if you are careful enough to craft numerically stable algorithms. DP simply hasn't been of great focus, after all it was only with the development of Kepler and GCN that this features was even added.
We mostly work on turbulent flow models (fluid dynamics) and we always use double precision when modeling except when data sets won’t fit in memory with double precision, algorithm does so little arithmetic that it is bandwidth limited or where we are able to use the vector hardware and single precision (16 singles in parallel instead of 8 doubles). I never worked as financial modeler, but I do read double precision is used there too.
Posted on Reply
#64
TheOne
With the announcement and release of the Titan RTX before the 2060, and with the 2060 most likely using the price point of the xx70's $350-450, this series is meant for the high end market and not the majority of gamers, which will make RT adoption slow, but at least now PhysX is open source.
Posted on Reply
#65
Vya Domus
unikinbut I do read double precision is used there too.
Sparingly, at best. Too many issues with rounding, questionable arbitrary conditioning and loss of money after certain repeated calculations. Fixed point (64 bit integer) reigns king.
Posted on Reply
#66
efikkan
People need to stop complaining about the price of Titan cards, and if you don't get the point of the card, it's not meant for you!

This is not a sign of lacking competition; even AMD have their counterpart "Vega Frontier Edition", priced at double the price of Vega 64. These are cards meant for developers and researchers, not for gamers. Also remember, these cards have limited availability in the market. Partners don't necessarily pay this price when getting these cards.
Posted on Reply
#67
Gasaraki
diatribeWell that's what happens when you have a monopoly. I say the government needs to step in a chop nVidia into multiple companies like they have in the past with other monopolies.
WTF are you on about? What is nVidia a monopoly of? The gpu market? Cause they are not the market leader. Just because they release something you can't afford, doesn't make them a monopoly. OMG I can't afford that new 8K 70" TV. What a monopoly, break them up. /s
Posted on Reply
#68
Sandbo
SIGSEGVhow much price of tesla v100? do they sacrifice tesla card?
576 multi-precision Turing Tensor Cores, providing up to 130 teraflops of deep learning performance.



I just feel pity to people/university/corporate who own tesla based HPC.
Tesla is still worth it for DP, just not HP anymore.
Posted on Reply
#69
GoldenX
So, Quadro price for GeForce performance.
Posted on Reply
#70
R-T-B
diatribeWell that's what happens when you have a monopoly. I say the government needs to step in a chop nVidia into multiple companies like they have in the past with other monopolies.
I would not say we're there yet. We're certainly treading dangerous turf though.
Posted on Reply
#71
xkm1948
Would be nice for our collaboration lab to have one of these in addition to the (now dated) 1950X
Posted on Reply
#72
XXL_AI
B-Real2500$, HAHAHAHA.



Knowing how faster RTX cards are than Pascals, maybe a 30% increase in workloads for 2500$ is ....
its not about %30 increase on general computing performance, it's about what we can do with other cores while training the dataset.
Posted on Reply
#73
R-T-B
TheinsanegamerNYou do not need governments regulating luxuries.
You do if they truly are a monopoly. Even luxuries can suffer from predatory pricing and computers aren't really a "luxery" anymore (though a Titan certainly is).

AMD still makes mainstreamish grade GPUs though. Saying this is like the AT&T monopoly is to massively overstate the situation.
Tsukiyomi91why bother complaining to the govt when they do not put regulations on tech?
Because they do? Case in point, Microsoft has been bitch slapped by the USA several times in the past. Even moreso in the EU...
Posted on Reply
#74
enya64
So surely for $2500 this card can use ray tracing at 4K (now that 4K is mainstream with 65 inch HDR TVs under $900) with at least 30 fps, right? Hurry up with an answer. My banker is on the other line asking if I am serious about opening this Home Equity Line of Credit.

Wait what do you mean "no but 1440p at almost 22fps may now be possible"? Will they be defective like the number of 2080ti, 2080, and 2070 cards that blue screened or artifacted in the first 2 months?

Wait, did you just suggest buying 2 of these for $5000 to see how high I can get with 1440p? Sure... :kookoo:
Posted on Reply
#75
EarthDog
enya64So surely for $2500 this card can use ray tracing at 4K (now that 4K is mainstream with 65 inch HDR TVs under $900) with at least 30 fps, right? Hurry up with an answer. My banker is on the other line asking if I am serious about opening this Home Equity Line of Credit.

Wait what do you mean "no but 1440p at almost 22fps may now be possible"? Will they be defective like the number of 2080ti, 2080, and 2070 cards that blue screened or artifacted in the first 2 months?

Wait, did you just suggest buying 2 of these for $5000 to see how high I can get with 1440p? Sure... :kookoo:
4K isn't mainstream for PC monitors in appropriate sizes...less than 2% of users have one (says steam stats).

Perhaps you can go take a look at this thread for some up to date news on its RT performance: www.techpowerup.com/forums/threads/dice-prepares-battlefield-v-rtx-dxr-performance-patch-up-to-50-fps-gains.250201/

You also have no idea how many cards have had issues. But you also must have missed the part about GN saying AIBs % were extremely low at that time (when people posted of issues) and NVIDIA said it wasn't higher than normal. Some of the issues were also situation specific and resolved with driver updates. The reality is, we have no idea. But I can tell you if it was a rampant issue, we would have seen A LOT more unhappy people than we did. Also, if you believe in the theory that the memory IC was the problem (I don't, few in the know seem to think so) they have also started using samsung along with the micron chips.
Posted on Reply
Add your own comment
Apr 25th, 2024 17:53 EDT change timezone

New Forum Posts

Popular Reviews

Controversial News Posts