Close ad

Server & Hosting AnandTech.com made a scandalous revelation that caught many Android phone manufacturers cheating on benchmarks by purposefully overclocking their chipsets during testing:

With the exception of Apple and Motorola, literally every OEM we've worked with sells (or sold) at least one device running this silly optimization. It's possible that older Motorola devices may have done the same thing, but none of the newer devices we've had with us have shown this behavior. It's a systematic problem that has apparently surfaced over the past two years, and it's far from just Samsung.

This revealing article was preceded by several other convictions, on the one hand in the case Samsung Galaxy S4 and the latest Galaxy Note 3:

The difference is respectable. In Geekbech's multi-core test, the Note 3 benchmark scored 20% better than it would have under "natural" conditions. If the possibility of a performance increase in the benchmarks is bypassed, the Note 3 will fall below the level of the LG G2, which we originally expected due to the identical chipset. Such a large increase just means that the Note 3 is messing with the CPU at idle; much more performance is made available when benchmarked on this device.

Samsung, HTC, LG, ASUS, all these manufacturers deliberately cheat in the benchmarks by purposefully overclocking the CPU and GPU to achieve higher results on paper. However, this increase only works for benchmarks included in the list inside the system, which is not easy to work towards. There is apparently a belief among manufacturers that “if he cheats others, we must too. After all, we will not be behind in the benchmarks".

Apple has never boasted about CPU clocks or benchmark results (with the exception of web browser benchmarks) on its iOS devices, it didn't need to. If the device works perfectly smoothly, the customer doesn't care about test scores whose names he can't even pronounce, let alone remember.

In the world of Android, everything is different, manufacturers are fighting with the same (or similar) weapons, and benchmarks are one of the few places where they can show that their device is better than others. However, this disclosure renders most benchmarks irrelevant, as reviewers and readers can no longer be sure who is cheating and who is not. A popular technical thing that is only used by reviewers to prove that they have really tested the device thoroughly, and to geeks for whom these numbers really mean something, maybe it will completely disappear from the mobile sphere and everyone will instead start looking at whether the system is smooth, as well as the application inside it . After all, it's always been that way with the iPhone.

It may not surprise anyone these days that Samsung and other manufacturers cheat to make themselves look better. But it's sad and embarrassing at the same time. Great admiration, on the other hand, goes to the server AnandTech i ArsTechnica, which proved specific lists of "supported" benchmarks parse from the code.

.