GPU Benchmarks and Hierarchy 2023: Graphics Cards Ranked
Our GPU benchmarks hierarchy ranks all the current and previous generation graphics cards by performance, including all of the best graphics cards. Whether it’s playing games or doing high-end creative work like 4K video editing, your graphics card typically plays the biggest role in determining performance, and even the best CPUs for Gaming take a secondary role.
Also, welcome to 2023! We’re in the process of retesting all of the GPUs on a slightly revamped test suite, using a Core i9-13900K instead of the current 12900K… but that’s not remotely complete yet, so for now we have our 2022 test suite. We’ve recently added the RTX 4070 Ti and RX 7900 XTX/XT to our list, which makes us mostly current on testing.
Our full GPU hierarchy using traditional rendering (aka, rasterization) comes first, and below that we have our ray tracing GPU benchmarks hierarchy. Those of course require a ray tracing capable GPU so only AMD’s RX 7000/6000-series, Intel’s Arc, and Nvidia’s RTX cards are present. The results are all without enabling DLSS, FSR, or XeSS on the various cards, mind you.
Nvidia’s new Ada Lovelace architecture powers its latest generation RTX 40-series, with new features like DLSS 3 Frame Generation. AMD’s RDNA 3 architecture powers the RX 7000-series, though only two cards are presently released. Meanwhile, Intel’s Arc Alchemist architecture brings a third player into the dedicated GPU party, though it’s more of a competitor for the previous generation midrange offerings.
On page two, you’ll find our 2020–2021 benchmark suite, which has all of the previous generation GPUs running our older test suite running on a Core i9-9900K testbed. We also have the legacy GPU hierarchy (without benchmarks, sorted by theoretical performance) for reference purposes.
The following tables sort everything solely by our performance-based GPU gaming benchmarks, at 1080p “ultra” for the main suite and at 1080p “medium” for the DXR suite. Factors including price, graphics card power consumption, overall efficiency, and features aren’t factored into the rankings here. We’ve switched to a new Alder Lake Core i9-12900K testbed, changed up our test suite, and retested all of the past several generations of GPUs. Now let’s hit the benchmarks and tables.
Mục lục bài viết
GPU Benchmarks Ranking 2022
Image 1 of 4
For our latest benchmarks, we test (nearly) all GPUs at 1080p medium and 1080p ultra, and sort the table by the 1080p ultra results. Where it makes sense, we also test at 1440p ultra and 4K ultra. All of the scores are scaled relative to the top-ranking 1080p ultra card, which in our new suite is the RTX 4090 (at least at 4K and 1440p).
You can also see the above summary chart showing the relative performance of the cards we’ve tested across the past several generations of hardware at 1080p ultra — swipe through the above gallery if you want to see the 1080p medium, 1440p and 4K ultra images. There are a few missing options (e.g., the GT 1030, RX 550, and several Titan cards), but otherwise it’s basically complete. We do have data in the table below for some of the other (older) GPUs.
The eight games we’re using for our standard GPU benchmarks hierarchy are Borderlands 3 (DX12), Far Cry 6 (DX12), Flight Simulator (DX11/DX12), Forza Horizon 5 (DX12), Horizon Zero Dawn (DX12), Red Dead Redemption 2 (Vulkan), Total War Warhammer 3 (DX11), and Watch Dogs Legion (DX12). The fps score is the geometric mean (equal weighting) of the eight games.
*: GPU couldn’t run all tests, so the overall score is slightly skewed at 1080p ultra.
While the RTX 4090 does technically take first place at 1080p ultra, it’s the 1440p and especially 4K numbers that impress. It’s only 4% faster than the next closest RX 7900 XTX at 1080p ultra, but that increases to 9% at 1440p and 22% at 4K. Against the RTX 3090 Ti, it’s also a major upgrade: 10% faster at 1080p, 23% faster at 1440p, and 51% faster at 4K.
(Just in case you check our reviews and notice a difference in scores, note that the above fps numbers incorporate both the average and minimum fps into a single score — with the average given more weight than the 99th percentile fps.)
Again, keep in mind that we’re not including any ray tracing or DLSS results in the above table, as we intend to use the same test suite with the same settings on all current and previous generation graphics cards. Since only RTX cards support DLSS (and RTX 40-series if you want DLSS 3), that would drastically limit which cards we could directly compare.
Of course the RTX 4090 comes at a steep price, though it’s not that much worse than the previous generation RTX 3090. In fact, we’d say it’s a lot better, as the 3090 was only a modest improvement in performance compared to the 3080 at the time of launch. Nvidia seems to have pulled out all the stops with the 4090, increasing the core counts, clock speeds, and power limits to push it beyond all contenders.
Stepping down from the RTX 4090, the RTX 4080 and RX 7900 XTX trade blows at higher resolutions, while AMD’s previous generation RX 6950 XT technically takes the lead at 1080p medium where CPU bottlenecks become the limiting factor. We’ve updated our test PC (you can see early results in our latest GeForce RTX 4070 Ti and Radeon RX 7900 XTX and 7900 XT (opens in new tab) reviews), and it’s a good time for updates as we need to retest all of the latest game patches and driver updates… but that will take some time.
Speaking of the RTX 4070 Ti, it ended up falling below the RX 7900 XT by up to 8% on average at 4K in our rasterization benchmarks. It will turn the table in ray tracing, but if you don’t care about RT, you can certainly make the argument that the 7900 XT represents a better value.
Turning to the previous generation GPUs, the RTX 20-series and GTX 16-series chips end up scattered throughout the results, along with the RX 5000-series. The general rule of thumb is that you get one or two “model upgrades” with the newer architectures, so for example the RTX 2080 Super comes in just below the RTX 3060 Ti, while the RX 5700 XT lands a few percent behind the RX 6600 XT.
Go back far enough, and you can see how modern games at ultra settings severely punish cards that don’t have more than 4GB VRAM. We’ve been saying for a few years now that 4GB is just scraping by, and 6GB or more is desirable. The GTX 1060 3GB, GTX 1050, and GTX 780 actually failed to run some of our tests, which skews their results a bit, even though they do better at 1080p medium.
Now let’s switch over to the ray tracing hierarchy.
(Image credit: Techland)
Ray Tracing GPU Benchmarks Ranking 2022
Enabling ray tracing, particularly with demanding games like those we’re using in our DXR test suite, can cause framerates to drop off a cliff. We’re testing with “medium” and “ultra” ray tracing settings. Medium means using medium graphics settings but turning on ray tracing effects (set to “medium” if that’s an option; otherwise, “on”), while ultra turns on all of the RT options at more or less maximum quality.
Because ray tracing is so much more demanding, we’re sorting these results by the 1080p medium scores. That’s also because the RX 6500 XT and RX 6400 along with the Arc A380 basically can’t handle ray tracing even at these settings, and testing at anything more than 1080p medium would be fruitless. We’ve finished testing all the current ray tracing capable GPUs, though there will be more cards in the near future.
The five ray tracing games we’re using are Bright Memory Infinite, Control Ultimate Edition, Cyberpunk 2077, Metro Exodus Enhanced, and Minecraft — all of these use the DirectX 12 / DX12 Ultimate API. (Note that we have had to drop Fortnite from our latest reviews, as the new version broke our benchmarks and changed the available settings. Thanks, Epic!) The fps score is the geometric mean (equal weighting) of the five games, and the percentage is scaled relative to the fastest GPU in the list, which again is the GeForce RTX 4090.
Image 1 of 4
If you felt the RTX 4090 performance was impressive at 4K in our standard test suite, just take a look at the results with ray tracing. We knew Nvidia had put even more ray tracing enhancements into the Ada Lovelace architecture, and those start to show up here — though there are still further potential performance improvements for ray tracing with SER, OMM, and DMM, not to mention DLSS3 (which honestly just seems to cause occasional artifacting and doesn’t really feel much smoother).
Even at 1080p medium, a relatively tame setting for DXR (DirectX Raytracing), the RTX 4090 roars past all contenders and leads the previous generation RTX 3090 Ti by 40%. At 1080p ultra, the lead grows to 56%, and it’s nearly 70% at 1440p. Nvidia made claims before the RTX 4090 launch that it was “2x to 4x faster than the RTX 3090 Ti” — factoring in DLSS 3’s Frame Generation technology — but even without DLSS 3, the 4090 is 80% faster than the 3090 Ti.
AMD continues to relegate DXR and ray tracing to secondary status, focusing more on improving rasterization performance — and on reducing manufacturing costs through the use of chiplets on the new RDNA 3 GPUs. As such, the ray tracing performance from AMD remains rather uninspiring. The new RX 7900 XTX basically matches Nvidia’s previous generation RTX 3080 12GB, which puts it just a bit behind the RTX 3080 Ti and RTX 3090 — and the new 4070 Ti outpaces it by 10% at 4K, 13% at 1440p, and 19% at 1080p. The step down RX 7900 XT meanwhile lands above the RX 6950 XT and just below the RTX 3080 10GB card.
You can also see what DLSS Quality mode did for performance in DXR games on the RTX 4090 in our review, but the short summary is that it boosted performance by 78% at 4K ultra. DLSS 3 meanwhile improved framerates another 30% to 100% in our preview testing, though we remain skeptical about the utility of Frame Generation outside of artificially boosting frame rates. That means with DLSS2, the 4090 in our ray tracing test suite is nearly four times as fast as AMD’s RX 7900 XTX. Ouch.
AMD’s FSR 2.0 would prove beneficial here, if AMD can get widespread adoption. Right now, only one of the games in our DXR suite (Cyberpunk 2077) has FSR2 support. Without FSR, AMD’s fastest GPUs can only clear 60 fps at 1080p ultra, while remaining decently playable at 1440p with 40–50 fps on average. But native 4K DXR remains out of reach for just about every GPU, with only the 3090 Ti, 4080, and 4090 breaking the 30 fps mark on the composite score — and a couple of games come up short on the 4080 and 3090 Ti.
The midrange GPUs like the RTX 3070 and RX 6700 XT basically manage 1080p ultra and not much more, while the bottom tier of DXR-capable GPUs barely manage 1080p medium — and the RX 6500 XT can’t even do that, with single digit framerates in most of our test suite, and one game that wouldn’t even work at our chosen “medium” settings. (Control requires at least 6GB VRAM to let you enabled ray tracing.)
Intel’s Arc A380 ends up just ahead of the RX 6500 XT in ray tracing performance, which is interesting considering it only has 8 RTUs going up against AMD’s 16 Ray Accelerators. Intel posted a deep dive into its ray tracing hardware, and Arc sounds reasonably impressive, except for the fact that the number of RTUs in the A380 severely limits performance. The top-end A770 still only has 32 RTUs, which proves sufficient for it to pull ahead (barely) of the RTX 3060 in DXR testing, but it’s can’t go much further than that. Arc A770 also ends up ahead of AMD’s RX 6800 in DXR performance, showing just how poor AMD’s RDNA 2 hardware is when it comes to ray tracing.
It’s also interesting to look at the generational performance of Nvidia’s RTX cards. The slowest 20-series GPU, the RTX 2060, still outperforms the new RTX 3050 by a bit, but the fastest RTX 2080 Ti comes in a bit behind the RTX 3070. Where the 2080 Ti basically doubled the performance of the 2060, the 3090 delivers about triple the performance of the 3050. Hopefully a future RTX 4050 will deliver similar gains as the 4090, at a far more affordable price point.
Choosing a Graphics Card
Which graphics card do you need? To help you decide, we created this GPU benchmarks hierarchy consisting of dozens of GPUs from the past four generations of hardware. Not surprisingly, the fastest cards use either Nvidia’s Ampere architecture or AMD’s Big Navi. AMD’s latest graphics cards perform well without ray tracing, but tend to fall behind once RT gets enabled — even more so if you enable DLSS, which you should. GPU prices are finally hitting reasonable levels, however, making it a better time to upgrade.
Of course it’s not just about playing games. Many applications use the GPU for other work, and we covered some professional GPU benchmarks in our RTX 3090 Ti review. But a good graphics card for gaming will typically do equally well in complex GPU computational workloads. Buy one of the top cards and you can run games at high resolutions and frame rates with the effects turned all the way up, and you’ll be able to do content creation work equally well. Drop down to the middle and lower portions of the list and you’ll need to start dialing down the settings to get acceptable performance in regular game play and GPU benchmarks.
It’s not just about high-end GPUs either, of course. We tested Intel’s Xe Graphics DG1, which basically competes with integrated graphics solutions. The results weren’t pretty, and we didn’t even try running any of those at settings beyond 1080p medium. Still, you can see where those GPUs land at the very bottom of the 2020-2021 GPU benchmarks list. Thankfully, Intel’s Arc Alchemist, aka DG2, appears to be cut from entirely different cloth… well, mostly.
If your main goal is gaming, you can’t forget about the CPU. Getting the best possible gaming GPU won’t help you much if your CPU is underpowered and/or out of date. So be sure to check out the Best CPUs for gaming page, as well as our CPU Benchmarks Hierarchy to make sure you have the right CPU for the level of gaming you’re looking to achieve.
(Image credit: Tom’s Hardware)
Test System and How We Test for GPU Benchmarks
We’ve used two different PCs for our testing. The latest 2022 and later configuration uses an Alder Lake CPU and platform, while our previous testbed uses Coffee Lake and Z390. Here are the details of the two PCs.
Tom’s Hardware 2022 GPU Testbed
Intel Core i9-12900K (opens in new tab)
MSI Pro Z690-A WiFi DDR4 (opens in new tab)
Corsair 2x16GB DDR4-3600 CL16 (opens in new tab)
Crucial P5 Plus 2TB (opens in new tab)
Cooler Master MWE 1250 V2 Gold (opens in new tab)
Cooler Master PL360 Flux (opens in new tab)
Cooler Master HAF500
Windows 11 Pro 64-bit
Tom’s Hardware 2020–2021 GPU Testbed
Intel Core i9-9900K (opens in new tab)
Corsair H150i Pro RGB (opens in new tab)
MSI MEG Z390 Ace (opens in new tab)
Corsair 2x16GB DDR4-3200 (opens in new tab)
XPG SX8200 Pro 2TB (opens in new tab)
Windows 10 Pro (opens in new tab) (21H1)
For each graphics card, we follow the same testing procedure. We run one pass of each benchmark to “warm up” the GPU after launching the game, then run at least two passes at each setting/resolution combination. If the two runs are basically identical (within 0.5% or less difference), we use the faster of the two runs. If there’s more than a small difference, we run the test at least twice more to determine what “normal” performance is supposed to be.
We also look at all the data and check for anomalies, so for example RTX 3070 Ti, RTX 3070, and RTX 3060 Ti all generally going to perform within a narrow range — 3070 Ti is about 5% faster than 3070, which is about 5% faster than 3060 Ti. If we see games where there are clear outliers (i.e. performance is more than 10% higher for the cards just mentioned), we’ll go back and retest whatever cards are showing the anomaly and figure out what the “correct” result would be.
Due to the length of time required for testing each GPU, updated drivers and game patches inevitably will come out that can impact performance. We periodically retest a few sample cards to verify our results are still valid, and if not, we go through and retest the affected game(s) and GPU(s). We may also add games to our test suite over the coming year, if one comes out that is popular and conducive to testing — see our what makes a good game benchmark for our selection criteria.
GPU Benchmarks: Individual Game Charts
The above tables provide a summary of performance, but for those that want to see the individual game charts, for both the standard and ray tracing test suites, we’ve got those as well. These charts were up-to-date as of December 13, 2022, with testing conducted using the latest Nvidia and AMD drivers in most cases, though some of the cards were tested with slightly older drivers.
Note that we’re only including the current and previous generations of hardware in these charts, as otherwise things get too cramped — and you can argue that with 29 cards in the 1080p charts, we’re already well past that point. (Hint: Click the enlarge icon if you’re on PC.)
These charts are up to date as of January 6, 2023.
Best Graphics Cards — 1080p Medium
Image 1 of 9
Image 1 of 6
Best Graphics Cards — 1080p Ultra
Image 1 of 9
Image 1 of 6
Best Graphics Cards — 1440p Ultra
Image 1 of 9
Image 1 of 6
Best Graphics Cards — 4K Ultra
Image 1 of 9
Image 1 of 6
Power, Clocks, Temperatures, and Fan Speeds
While our GPU benchmarks hierarchy sorts things solely by performance, for those interested in power and other aspects of the GPUs, here are the appropriate charts.
Image 1 of 8
If you’re looking for the legacy GPU hierarchy, head over to page two! We moved it to a separate page to help improve load times in our CMS as well as for the main website. And if you’re looking to comment on the GPU benchmarks hierarchy, head over to our forums (opens in new tab) and join the discussion!