DieselGate vs. GeekbenchGate
In the world of technology, benchmark tests that evaluate device performance are an important guide for consumers. However, it turns out that we cannot see the real performance values because some devices run "artificial benchmark mode" in these tests. For this reason, GeekBench has "Excluded" some devices from its list.
Of course, it is not hard to guess the purpose: to get a higher score in the test results and to appear powerful.
However, this does not accurately reflect the performance offered by the device in real-world conditions. I think it seems quite dangerous and misleading for those who do research on the performance of phones and those who are thinking of buying a new phone.
Volkswagen Emission Scandal: Some Parallels, But Different Dimensions
This situation may remind you of a famous scandal in the automotive world: the Volkswagen Emission Scandal.
Volkswagen had shown low emission values by activating the "module specific to test conditions" in emission tests in 2015. However, this situation brought serious sanctions because it violated legal obligations.
There is no such legal obstacle in Geekbench tests. It is only important to be aware that real performance cannot match the tests exactly.
For those who want to examine the Volkswagen scandal in more detail, you can take a look at the BBC's news.
From Technology to Automotive: Why Real-World Assessment is Important
Volkswagen's test manipulation in violation of legal obligations has a different dimension than the legal and ethical discussions of Geekbench tests. However, the risk of damaging consumers' trust in devices or services is a common problem in both cases.
Seeing Real Performance is Important
If you are making a decision based only on the high performance of a device or vehicle in tests, you may be living in a misleading picture. You can gain awareness of this issue by looking at the Excluded Devices list on Geekbench regarding mobile phones.
Here are the top-ranking mobile phones:
Positions 4 to 11 are also Apple phones, followed by the Oppo Find X8 Pro
Note: The first lines are occupied by reliable and trustworthy products, but I was surprised to see such a well-known brand appear so frequently on the "Excluded" list. Link: https://browser.geekbench.com/mobile-benchmarks
GeekBench Excluded Devices
When well-known big companies do this, we tend to forget and ignore it, but if it is a new company, I think it could be hit much harder.
Real performance and transparency should be measured not only with data from tests but also with long-term trust and ethical standards.