Which chip is faster: Apple’s M1 or Intel’s Core i7? The new or the old? ARM or x86? The mobile gadgets company or the major microprocessor maker? 

Spoiler alert! It’s a trick question – a Rorschach test. You’ll see what you want to see in the benchmark results, and what you take out of the scores is, as Yoda says, “only what you take with you.” 

Computer benchmarking, like auto racing, has been around ever since they made the second one. It’s natural to try to find out which chip is “better,” for some definition of better. Drag racing a couple of CPUs seems easy, but once you get into it you realize it’s fraught with problems. What, exactly, are you measuring? Computers do different things differently, so deciding what to measure is just as important – if not more so – than the actual measurements. 

Apple clearly felt that designing its own ARM-based chips was better than buying Intel’s x86-based processors. But better how? Was the Cupertino company simply looking to save money? To reduce power consumption? Improve performance? Gain control over its CPU roadmap? All of the above? 

As soon as M1-based Macs went on sale, people started benchmarking them. And the results were… pretty good! The M1 seems fast and it appears to deliver good battery life. A home run, then? A big technological win for Apple? Maybe… maybe not. 

It was equally inevitable that x86 partisans would benchmark equivalent Intel processors. And those results were… also pretty good! Then Intel itself weighed in with a very Apple-specific presentation comparing M1 against its own Core i7 processor. Well, processors, plural, as we’ll see. 

As you might expect, the Intel-supplied benchmarks showed Intel on top, sometimes outperforming M1 by ratios of 3:1 or even 6:1. Somewhat less expectedly, Intel also took on Apple in a battery-life test, graciously admitting defeat by the barest 1% margin (10 hours, 6 minutes of battery life vs. 10 hours, 12 minutes.)

Source: Intel

Source: Intel

Source: Intel

Seems pretty straightforward, right? Surely you can’t fake such large differences in performance, and Intel’s candid willingness to concede a tiny advantage to Apple shows that their heart’s in the right place. Bonus points for honesty. 

Well, yes and no. Benchmarks show what you want them to show, and Intel’s benchmarks were… unusual. Nowhere do we see the standard benchmarks like GeekBench, 3DMark, Cinebench, CoreMark, PassMark, SPECmark, or even the hoary old Dhrystone. Instead, we’re treated to Microsoft Office 365 apps running so-called RUG: Intel’s own definition of “real-world usage guidelines.” Not a benchmark I’m familiar with. You? 

The numbers also show browser tests using the WebXPRT 3 benchmark,  which was developed by Principled Technologies in cooperation with Intel. It relies heavily on x86 extensions, so guess how that one turned out. For the record, AMD processors do well on WebXPRT 3, too. 

Intel’s most impressive performances came from Topaz Labs’s AI tests. But like WebXPRT, Topaz’s software leans heavily on x86-specific architecture extensions. And this highlights a fundamental question about benchmarks. Should we use tests deliberately designed to favor one CPU architecture over another? One on hand, optimizing code is A Good Thing, and there’s every reason to design a test to exercise unique parts of the hardware. And vice versa. Plenty of CPU designs get tweaked to improve software performance. We call that progress. Should a benchmark highlight such progress or hide it under a blanket? Intel’s thrashing of Apple’s M1 in this case is wholly deserved. But is it relevant? That’s up to you. 

Flipping from performance to efficiency, we find some “benchmarketeering” going on. Intel changed both sides of the equation for the battery tests, swapping out both its hardware and its competitor’s. For the abovementioned performance tests, Intel used a Core i7-1185G7 processor running Windows 10 Pro “on [an] Intel white-box system.” In other words, we don’t know anything about the motherboard, core logic, disks, or any other hardware that may have been involved. We do know it was running at 3.0 GHz with 16 GB of LPDDR4-4266. On the Apple side, Intel chose a MacBook Pro running MacOS 14.0.1 and outfitted with Apple’s 3.2-GHz M1 processor and the same 16 GB of LPDDR4-4266. 

That’s for the performance tests. For the battery tests, Intel switched to a commercial Acer laptop with a slightly different Core i7-1165G7 processor. No explanation was given. More significantly, it also swapped out the MacBook Pro for a MacBook Air, which has a smaller battery. (Both Apple machines use the same M1 processor and DRAM.) The two dueling laptops were able to play Netflix videos on battery power for essentially the same amount of time, with a difference of just 6 minutes over 10 hours. Had Intel used the same MacBook Pro that it used in the performance tests, however, it certainly would have been trounced. 

Benchmarks aren’t everything, and Intel offered more than just scores. The company also promoted qualitative differences between Apple’s MacBooks and the world of x86-based laptops. In fact, only three or four of Intel’s 21-slide presentation covered actual benchmarks. Most of the rest was devoted to squishier points about “new experiences” and “day in the life responsiveness scenarios” and “choice.” (Plus four slides of small print on disclaimers and configuration details.) 

Intel’s main point here was that there are a lot of PC makers in the world, but only one Apple. PCs have more peripherals; PCs have more games; PCs come in more shapes and sizes; PCs can have multiple monitors; PCs cover a broader price spectrum. In the end, Intel’s “benchmark” presentation was really about lifestyle. Do you want to be part of the PC ecosystem or the MacBook ecosystem? 

And that’s the real question, and the one that makes all the CPU benchmarks irrelevant. Who cares if Apple’s M1 processor is slightly faster or slower than Intel’s current laptop processors? Who actually chooses an Apple, Acer, Dell, or Lenovo system based on that? 

Apple doesn’t sell M1 chips, so the distinction is irrelevant to engineers. We can’t design around M1 even if we wanted to. We’ll never have to decide between the two. There’s exactly zero cross-shopping between Intel processors and Apple processors. 

There’s also little cross-shopping between Apple systems and Intel-based systems. End users pick the ecosystem, not the CPU. Do they want MacOS or Windows? Once you’ve made that call, the rest fades into the background. The choice is between buying a Mac or not buying a Mac. In the former case, you’re getting M1 (or its successors), and if not, you’re not. 

That said, Intel needed to save face and remind the world that it still makes good laptop processors. It just went about it in a typically Intel way. Maybe this is a good time to resurrect the “Intel Inside” ad campaign on TV. 

For us technology nerds who benchmark CPUs for recreation, the results are interesting but not very useful. Vendor-supplied benchmarks are always suspect, no matter the vendor. The term “cherry picking” comes to mind, and these tests seem well picked over. Yes, they show the old stalwart outperforming the new media darling, but is anyone really convinced? Will it sway anyone’s design decision? Or did we already know the results before we even looked?