(03-09-2016, 11:30 AM)ssvb Wrote:(03-09-2016, 03:53 AM)Andrew2 Wrote: The whole http://openbenchmarking.org site is just a huge collection of meaningless numbers since the differences listed there are mostly influenced by compiler versions/settings and thermal conditions but he still encourages his users to misinterpret them as 'hardware benchmarks'.Well, all of these flaws have been known and reported ages ago: http://www.phoronix.com/forums/forum/sof...post320735
But as long as the Phoronix readers are happy with these tests, nothing is going to improve. There is simply no incentive to do a better job.
I tried to create a little puzzle game with A83T: http://openbenchmarking.org/result/16030...M3+Armbian
Why gets my BPi M3 slower 'John the Ripper' scores than his BPi M3 but in all other tests it's way faster? Since I disabled code optimisations for JTR and enabled reasonable settings for the other tests. The results published there are just a huge collection of garbage. Unfortunately you're right and nothing will change since people love to compare graphs made from numbers without meaning
I'm already curious how expensive Pine64+ gets when it's about to 'toss the dice for the price' for his Performance / Cost nonsense...
BTW: Not only the whole test methodology and most of the tests are broken. But not taking thermal settings/behaviour into account in 2016 is simply doing it wrong when it's about using these meaningless numbers the Phoronix users and Michael collect to compare different boards with.