On December 22nd, Consumer Reports said it could not recommend the MacBook Pro — a first for a Mac laptop. It caused a stir! Consumer Reports’ reasoning was simple: it got wildly inconsistent battery test results every time it tried to test multiple versions of the laptop. Its test is one that’s pretty common across the industry, loading up web pages one after another:
For the battery test, we download a series of 10 web pages sequentially, starting with the battery fully charged, and ending when the laptop shuts down. The web pages are stored on a server in our lab, and transmitted over a WiFi network set up specifically for this purpose. We conduct our battery tests using the computer’s default browser—Safari, in the case of the MacBook Pro laptops.
In that test, CR saw the 13-inch MacBook Pro (with the Touch Bar) get results from 16 hours all the way down to less than 4 hours — again, wildly inconsistent. Similarly, the 15-inch version saw results range from a “that can’t be right” 18.5 hours down to 8 hours. Because the results ranged so widely, CR concluded that it’s not a good idea to buy this laptop until we know more about why these battery results are so inconsistent.
Yesterday, Apple’s Phil Schiller tweeted that the company itself doesn’t see anything like these results and is “Working with CR to understand their battery tests.”