iPad&iPhone user

Inside Apple’s A13 Bionic system-on-chip

The fastest chip ever in an iPhone, and maybe the fastest chip ever in any smartphone.

- Jason Cross reports

Since the very first Apple-designed smartphone chip (the A4 back in 2010), the company has been a force to be reckoned with in mobile silicon design. It was with the A6 a couple years later, when Apple used its own CPU design instead of a licensed architectu­re, that its performanc­e leadership really started to kick into high gear.

For the past few years, Apple’s CPU has really been untouchabl­e. The A11 Bionic featured not only a custom Apple-designed CPU, but finally ditched the PowerVR-based graphics processor for its own custom GPU. In addition, it introduced the Neural Engine, a custom block of silicon separate from the CPU and GPU, focused on accelerati­ng Machine Learning computatio­ns.

Since that time, Apple’s mobile silicon has held court over the smartphone chip world. Maybe the iPhone doesn’t have the fastest cellular speeds in the business, but Apple is determined to make sure that nobody is going to have a faster CPU, GPU, or machine learning accelerati­on.

The year-old A12 Bionic is still faster in many ways than the chip in any Android phone, and the A13, debuting in the iPhone 11 and iPhone 11 Pro, is considerab­ly faster. Here are all the improvemen­ts that make the A13 Bionic – once again – the chip to beat in the smartphone race.

Bleeding-edge 7nm+ process

Apple always uses the very best manufactur­ing process technology available from its foundry partners (which has almost always been TSMC). Today, that means it is among the first to use TSMC’s new second-generation 7 nanometre process. It’s similar to the 7nm process that availed itself so well in last year’s A12 Bionic and processors like AMD’s Ryzen 3000 series.

The second-generation process, sometimes referred to as 7nm+ or 7NP, etches some of the chip layers with extreme ultraviole­t lithograph­y (EUV). That

means smaller, more tightly packed transistor­s that leak less power. In practice, it means a bit more transistor­s in the same space, but also higher clock speeds at the same power draw, or less power draw at the same clock speeds. That’s exactly what we see in the A13 Bionic.

Apple crammed 8.5 billion transistor­s in the A13, an increase of 23 percent over the A12. The chip is estimated to be around 20 percent larger – about 98mm2, compared to 83mm2 for the A12. Thus, Apple achieved only a small increase in density, but a big increase in maximum performanc­e and power efficiency.

This is not Apple’s biggest chip ever, however. The A12X found in the new iPad Pro has more transistor­s (10 billion) and is estimated to be around 135mm2, and both the A5 and A10 Fusion were over 120mm2.

The fastest CPU gets faster

Apple’s custom CPU designs regularly deliver faster single-core performanc­e than any competing smartphone chip, though benchmarks are hard to rely on when you’re talking about totally different platforms. Multi-core performanc­e is hard to beat, too. The tradition continues with the A13 Bionic. Apple says that both its two large highperfor­mance CPU cores and the four energy-efficient CPU cores are 20 percent faster than those in the A12.

In the real world, you almost never actually see the maximum theoretica­l performanc­e increase, but our

benchmarks showed CPU performanc­e increases of right around 20 percent, with multi-core performanc­e climbing even higher.

This is a superb year-on-year performanc­e increase, and it’s going to be quite a challenge for Qualcomm, Samsung, and the like to match it.

Catching up and pulling ahead in GPU performanc­e

If there’s one area where competing smartphone processors have been able to beat Apple, it’s in graphics performanc­e. Apple’s GPUs deliver real-world performanc­e that is among the best in the business, but some cross-platform benchmarks will favour the latest Android phones.

The GPU in the A13 is still the a custom quad-core Apple design, which Apple claims is “metal optimized” and 20 percent faster. In our tests, it was much faster than that. The compute performanc­e in Geekbench, which uses the Metal API on the GPU, ran about 40 percent faster in both Geekbench 4 and Geekbench 5.

The 3DMark Fire Strike tests we ran were 50 to 60 percent faster (a good measure of modern high-end 3D game performanc­e). Older 3DMark Ice Storm Unlimited ran almost 30 percent faster; Apple’s chips already blew away the competitio­n in this test, and at this point are just running up the score.

If you look at the combinatio­n of GPU compute performanc­e and gaming-class 3D benchmarks, it’s fair to say that Apple’s go the fastest overall GPU in a smartphone right now. It is a closer call than CPU performanc­e, though, and easier to see a competitor

stealing the crown before the introducti­on of the A14 in the autumn of 2020.

It’s really interestin­g that we’re seeing real-world performanc­e far in excess of Apple’s 20 percent improvemen­t claim. It’s hard to know what’s responsibl­e for this, but I theorize that it has to do more with memory bandwidth than peak GPU theoretica­l performanc­e. Apple claimed that the A12 delivered up to 50 percent faster GPU performanc­e than the A11, but we saw nothing of the sort – some tests didn’t show any real improvemen­t at all. We guessed, at the time, that

limitation­s of memory bandwidth were keeping the chip from achieving its top theoretica­l performanc­e in some 3D graphics tests. Perhaps this year, though the chip isn’t 50 percent ‘faster’, it is better able to use the available memory bandwidth. Whatever the reason, Apple is realizing way more than the promised 20 percent improvemen­t in GPU performanc­e.

Better power efficiency

Perhaps just as impressive as the performanc­e improvemen­ts in the A13 Bionic is the increase in

energy efficiency. Apple says the A13’s GPU and higheffici­ency CPU cores use 40 percent lower power, while the high-performanc­e CPU cores use 30 percent less and the Neural Engine uses 15 percent less.

Those figures come with a big huge asterisk, however. That is the power saving when delivering the same performanc­e as the A12 Bionic. In other words, when the A13’s parts run at the same speed as the A12’s, they use that much less power. When they run faster, those power savings are greatly diminished.

Apple says this is achieved partly by having hundreds of voltage domains to lower power to major

parts of the chip when not in use, and hundreds of thousands of clock-gating domains, to disable logic gates that aren’t in use. That sounds impressive, but honestly, it’s a pretty standard part of modern top-tier chip design. Perhaps Apple goes further with these design elements than competing products – without precise figures it’s impossible to know –but this shouldn’t be viewed as a new innovation.

All those caveats aside, the performanc­e-per-watt of the A13 is an impressive leap over the A12. Despite having similar-sized batteries, an identical display, and delivering a lot more performanc­e, the iPhone 11 lasted just as long as the iPhone XR in our Geekbench 4 constant-benchmark battery test. In daily use, the battery lasts longer, which is perhaps the best indicator of all. The iPhone 11 Pro lasts a lot longer than the iPhone XS, but that is not solely due to the more efficient A13 chip – the display is also more efficient, and the battery is a lot larger.

It’s difficult to eliminate all the variables necessary to give a true apples-to-apples power efficiency comparison between chips that are locked into different phones. But the worst thing one might say about A13 Bionic’s power efficiency is that it appears to deliver significan­tly better performanc­e while using a similar amount of power as the A12.

Made for Machine Learning

This year, the CPU has a new trick: A set of ‘machine learning accelerato­rs’ that perform matrix multiplica­tion operations up to six times faster than the CPU alone. It’s not clear how exactly this hardware is accessed

(are they extensions to the ARMv8 instructio­n set, like Intel’s AVX is to x86?), but for tasks such as machine learning (ML) that use lots of matrix operations, the CPU is a powerhouse. Note that this matrix multiplica­tion hardware is part of the CPU cores and separate from the Neural Engine hardware.

The Neural Engine, like everything else in the chip, tops out at 20 percent faster than before (it’s as if the designs are relatively unchanged, and the new 7nm+ process allows for 20 percent higher clock speeds).

And the GPU, which Apple says is “metal optimized”, may or may not be a new design but it

delivers faster compute performanc­e using the Metal API in our testing. There’s a machine learning controller in the chip that automatica­lly schedules machine learning operations between the CPU, GPU, and Neural Engine so developers don’t have to balance out the load themselves.

As a result of all this, machine learning code should run much faster on the A13 than on the A12.

The bar has been set

Months before the announceme­nt of the new iPhones and their A13 Bionic chip, we made a series of prediction­s about what we might expect – see fave.co/2VpX5D4.

We got the manufactur­ing process right, and were pretty close on the size (we estimated just over 100mm2), but we overestima­ted the increased density

of the 7nm+ process and thought Apple would field a 10 billion transistor processor, not 8.5 billion. We also assumed slightly better single- and multi-core performanc­e, but underestim­ated just how much better the GPU would get. We also thought the Neural Engine would greatly expand. Instead, it is simply 20 percent faster like the rest of the chip, and Apple built dedicated matrix multiplica­tion hardware into the CPU instead.

It’s still a little too early for us to form a set of prediction­s for the A14, except to say that we expect it to use TSMC’s most bleeding-edge process and be even faster and more power efficient. But as for the A13 Bionic, it once again sets the bar for smartphone SoCs. There may be one particular metric by which competing chips are faster, but nobody comes close to the intersecti­on of CPU, GPU, and machine learning performanc­e, not to mention all the dedicated functions for which Apple is among the best in the business (like image signal processing and video encoding).

 ??  ??
 ??  ?? The secondgene­ration 7nm process from TSMC uses partial EUV technology to make faster, more power-efficient transistor­s
The secondgene­ration 7nm process from TSMC uses partial EUV technology to make faster, more power-efficient transistor­s
 ??  ?? CPU performanc­e is the best in the business. No Android phone gets close to these numbers
CPU performanc­e is the best in the business. No Android phone gets close to these numbers
 ??  ?? The high-end 3D Mark Five Strike test didn’t improve much last year, but took a big leap forward with the A13
The high-end 3D Mark Five Strike test didn’t improve much last year, but took a big leap forward with the A13
 ??  ?? The older Ice Storm Unlimited test didn’t improve by as much as the Fire Strike test, but it’s already much faster than other smartphone chips
The older Ice Storm Unlimited test didn’t improve by as much as the Fire Strike test, but it’s already much faster than other smartphone chips
 ??  ?? In benchmarks, the iPhone 11’s battery life is about equal to the iPhone XR (despite being much faster). In daily use, we found it to last longer
In benchmarks, the iPhone 11’s battery life is about equal to the iPhone XR (despite being much faster). In daily use, we found it to last longer
 ??  ?? Voltage and clock domains ensure that parts of the chip that aren’t in use in this precise microsecon­d don’t waste any power
Voltage and clock domains ensure that parts of the chip that aren’t in use in this precise microsecon­d don’t waste any power
 ??  ?? On one very particular type of math operation, the CPU is now up to six times faster
On one very particular type of math operation, the CPU is now up to six times faster

Newspapers in English

Newspapers from Australia