My RAM is corrupted

[prof7bit]

I've got a brand new Rock64 and ever since I managed to set it up as a small NAS device for a bunch of USB drives I observed strange Image corruption when streaming known good movie files from the Rock64 to my Kodi box. And a strange mysql crash and mysql database corruption once every week. When copying the same 16GB file from the Rock to my desktop twice and doing a binary diff it comes up with quite a lot of differences most often bit 7 of some random byte in the file is flipped (a lot of them in this large file, I didn't yet find an easy way to count all differences, most binary compare tools stop at the first difference and the others complain the file is too large)

Today I installed and ran memtester on 80% of the RAM (810M of 1GB that could be locked at runtime) and was immediately greeted by a large list of errors (see below).

It would be nice if everybody who is reading this could try this with his device too and report back whether it shows errors or not, this way it would be possible to estimate how many percent of devices were shipped with bad RAM and how my chances are that I will be able to have it exchanged for a working one.

This is the second of a total of 2 ARM devices (100%) I bought this year that had memory corruption, the first one was a Western Digital NAS that destroyed around 2TB of my movie collection by introducing subtle bit flips every few hundred MB and the second one is the Rock64 that was meant to replace the WD and hopefully work better.

Fortunately this time I did not yet copy any more files around with it and therefore have not yet introduced even more damage.

Code:

--($)-- sudo memtester 810M
memtester version 4.3.0 (64-bit)
Copyright (C) 2001-2012 Charles Cazabon.
Licensed under the GNU General Public License version 2 (only).

pagesize is 4096
pagesizemask is 0xfffffffffffff000
want 810MB (849346560 bytes)
got  810MB (849346560 bytes), trying mlock ...locked.
Loop 1:
 Stuck Address       : testing   0FAILURE: possible bad address line at offset 0x02c10680.
Skipping to next test...
 Random Value        : FAILURE: 0xfffe8fc8fe6fe359 != 0xfffe8fc8feefe359 at offset 0x0034ce78.
FAILURE: 0xbb6fd072b7ff55f9 != 0xbb6fd072b77f55f9 at offset 0x0189c680.
FAILURE: 0x7f3f47f8fffefe30 != 0x7f3f47f8ff7efe30 at offset 0x07ee4680.
FAILURE: 0xed373bbefaefa834 != 0xed373bbefa6fa834 at offset 0x08ba4680.
FAILURE: 0xff7339dd1fef849b != 0xff7339dd1f6f849b at offset 0x0b88c680.
FAILURE: 0xfafffa7da3ff7ca6 != 0xfafffa7da37f7ca6 at offset 0x0ca7c680.
FAILURE: 0x3fef4e4d5beb14fe != 0x3fef4e4d5b6b14fe at offset 0x0dd54680.
FAILURE: 0xb65a38c84ffeadae != 0xb65a38c84f7eadae at offset 0x122c4680.
FAILURE: 0xd7b9496fffbe618 != 0xd7b9496ff7be618 at offset 0x135e4680.
FAILURE: 0x8b88b2dd7bf977f != 0x8b88b2dd73f977f at offset 0x13ac4680.
FAILURE: 0xfdea03fb7fff47b6 != 0xfdea03fb7f7f47b6 at offset 0x14804680.
FAILURE: 0x8481855a8111cbc9 != 0x8481855a8191cbc9 at offset 0x0034ce78.
FAILURE: 0xc010dae0c8817d69 != 0xc010dae0c8017d69 at offset 0x0189c680.
FAILURE: 0x289046ec14850313 != 0x289046ec14050313 at offset 0x0337c680.
FAILURE: 0x3ca86bb930c1d79b != 0x3ca86bb93041d79b at offset 0x063d4680.
FAILURE: 0x9648312c859180a4 != 0x9648312c851180a4 at offset 0x08ba4680.
FAILURE: 0x9490b667908531d6 != 0x9490b667900531d6 at offset 0x0a5a4680.
FAILURE: 0xc42ca61a09164e5 != 0xc42ca61a01164e5 at offset 0x0b8a4680.
FAILURE: 0x16887d8e0195f85d != 0x16887d8e0115f85d at offset 0x11b24680.
FAILURE: 0x8412762a809150f1 != 0x8412762a801150f1 at offset 0x12204680.
FAILURE: 0xcd25325a3080853e != 0xcd25325a3000853e at offset 0x122c4680.
FAILURE: 0x84dbd436c4858988 != 0x84dbd436c4058988 at offset 0x14d14680.
FAILURE: 0xec813f96c2a1ee73 != 0xec813f96c221ee73 at offset 0x175dc680.
FAILURE: 0x8846ac149800adf != 0x8846ac149000adf at offset 0x176e4680.
FAILURE: 0x848425f7d080791d != 0x848425f7d000791d at offset 0x176ec680.
 Compare XOR         : FAILURE: 0x4a64f506019259d4 != 0x4a64f506021259d4 at offset 0x0034ce78.
FAILURE: 0x85f44a8c49020b74 != 0x85f44a8c48820b74 at offset 0x0189c680.
FAILURE: 0x4ea9f8f1813a6e72 != 0x4ea9f8f181ba6e72 at offset 0x01f84e78.
FAILURE: 0xee73b6979505911e != 0xee73b6979485911e at offset 0x0337c680.
FAILURE: 0x28bdb64b14265a6 != 0x28bdb64b0c265a6 at offset 0x063d4680.
FAILURE: 0x79efb73a42fb4e60 != 0x79efb73a427b4e60 at offset 0x07f94680.
FAILURE: 0x5c2ba0d806120eaf != 0x5c2ba0d805920eaf at offset 0x08ba4680.
FAILURE: 0x5a7426131105bfe1 != 0x5a7426131085bfe1 at offset 0x0a5a4680.
FAILURE: 0xd2263a0d2111f2f0 != 0xd2263a0d2091f2f0 at offset 0x0b8a4680.
FAILURE: 0xdc6bed3982168668 != 0xdc6bed3981968668 at offset 0x11b24680.
FAILURE: 0x49f5e5d60111defc != 0x49f5e5d60091defc at offset 0x12204680.
FAILURE: 0x9308a205b1011349 != 0x9308a205b0811349 at offset 0x122c4680.
FAILURE: 0x4abf43e245061793 != 0x4abf43e244861793 at offset 0x14d14680.
FAILURE: 0xb264af4243227c7e != 0xb264af4242a27c7e at offset 0x175dc680.
FAILURE: 0xce67da6cca0098ea != 0xce67da6cc98098ea at offset 0x176e4680.
FAILURE: 0x4a6795a351010728 != 0x4a6795a350810728 at offset 0x176ec680.
 Compare SUB         : FAILURE: 0x38214bca9557d9ac != 0x9a5bcb8944d7d9ac at offset 0x0034ce78.
FAILURE: 0x2ce4795964aff48f != 0x2ce47959642ff48f at offset 0x010ea680.
FAILURE: 0xe8749cbf0fe5e40c != 0x863a1d006065e40c at offset 0x0189c680.
FAILURE: 0x6b7e4440282aa64e != 0x6b7e444028aaa64e at offset 0x01f84e78.
FAILURE: 0x8de7434929ce8022 != 0x2bacc38a7a4e8022 at offset 0x0337c680.
FAILURE: 0xd68d8ea091ebdbde != 0xd68d8ea0916bdbde at offset 0x042e4680.
FAILURE: 0x3ecb35ab9fc69a != 0x9e044b76fc1fc69a at offset 0x063d4680.
FAILURE: 0x6d7acaaa2226f5a0 != 0xb404aeb72a6f5a0 at offset 0x07f94680.
FAILURE: 0x3d7899c0fe2fe5f1 != 0xdb3e1a024eafe5f1 at offset 0x08ba4680.
FAILURE: 0x650f925334f2117f != 0x2d512948572117f at offset 0x0a5a4680.
FAILURE: 0xc77566bac6585710 != 0x653ae6fc16d85710 at offset 0x0b8a4680.
FAILURE: 0x56d7597c92ebb31f != 0x56d7597c926bb31f at offset 0x0ca7c680.
FAILURE: 0xdee45bf8babf61be != 0xdee45bf8ba3f61be at offset 0x10194680.
FAILURE: 0xe1ceddd34794a898 != 0x7f945e149814a898 at offset 0x11b24680.
FAILURE: 0x89a603b76c86cb84 != 0x276b83f8bd06cb84 at offset 0x12204680.
FAILURE: 0x4d1b323d7f87cd17 != 0xeae0b27ed007cd17 at offset 0x122c4680.
FAILURE: 0xf5ac9af7ae32868d != 0x93721b38feb2868d at offset 0x14d14680.
FAILURE: 0x10916099da17b8c2 != 0xae56e0db2a97b8c2 at offset 0x175dc680.
FAILURE: 0x20b7e6c48aefe886 != 0x20b7e6c48a6fe886 at offset 0x175e4680.
FAILURE: 0xbae7a00b99f900d6 != 0x58ad204cea7900d6 at offset 0x176e4680.
FAILURE: 0x9b0f780cd0b82fd8 != 0x38d4f84e21382fd8 at offset 0x176ec680.
 Compare MUL         : FAILURE: 0x00000001 != 0x00000000 at offset 0x0189c680.
FAILURE: 0x00000000 != 0x00000001 at offset 0x08ba4680.
FAILURE: 0x00000001 != 0x00000000 at offset 0x0b8a4680.
FAILURE: 0x00000001 != 0x00000000 at offset 0x11b24680.
FAILURE: 0x00000000 != 0x00000001 at offset 0x122c4680.
FAILURE: 0x00000001 != 0x00000000 at offset 0x14d14680.
FAILURE: 0x00000000 != 0x00000001 at offset 0x175dc680.
FAILURE: 0x00000001 != 0x00000000 at offset 0x176e4680.
 Compare DIV         : FAILURE: 0xdef7b74c5fefe49f != 0xdef7b74c5fefe49e at offset 0x0189c680.
FAILURE: 0xdef7b74c5fefe49e != 0xdef7b74c5fefe49f at offset 0x08ba4680.
FAILURE: 0xdef7b74c5fefe49f != 0xdef7b74c5fefe49e at offset 0x0b8a4680.
FAILURE: 0xdef7b74c5fefe49f != 0xdef7b74c5fefe49e at offset 0x11b24680.
FAILURE: 0xdef7b74c5fefe49e != 0xdef7b74c5fefe49f at offset 0x122c4680.
FAILURE: 0xdef7b74c5fefe49f != 0xdef7b74c5fefe49e at offset 0x14d14680.
FAILURE: 0xdef7b74c5fefe49e != 0xdef7b74c5fefe49f at offset 0x175dc680.
FAILURE: 0xdef7b74c5fefe49f != 0xdef7b74c5fefe49e at offset 0x176e4680.
 Compare OR          : FAILURE: 0x98d6214058e7a095 != 0x98d6214058e7a094 at offset 0x0189c680.
FAILURE: 0x98d6214058e7a094 != 0x98d6214058e7a095 at offset 0x08ba4680.
FAILURE: 0x98d6214058e7a095 != 0x98d6214058e7a094 at offset 0x0b8a4680.
FAILURE: 0x98d6214058e7a095 != 0x98d6214058e7a094 at offset 0x11b24680.
FAILURE: 0x98d6214058e7a094 != 0x98d6214058e7a095 at offset 0x122c4680.
FAILURE: 0x98d6214058e7a095 != 0x98d6214058e7a094 at offset 0x14d14680.
FAILURE: 0x98d6214058e7a094 != 0x98d6214058e7a095 at offset 0x175dc680.
FAILURE: 0x98d6214058e7a095 != 0x98d6214058e7a094 at offset 0x176e4680.
 Compare AND         : FAILURE: 0x6af9587ee02b39b4 != 0x6af9587ee0ab39b4 at offset 0x015dce78.
FAILURE: 0x6af9587ee02be9b4 != 0x6af9587ee0abe9b4 at offset 0x01634e78.
FAILURE: 0x6af9587ee03b09b4 != 0x6af9587ee0bb09b4 at offset 0x01dc4e78.
FAILURE: 0x6af9587ee03e89b4 != 0x6af9587ee0be89b4 at offset 0x01f84e78.
FAILURE: 0x6af9587ee0eb08b5 != 0x6af9587ee06b08b5 at offset 0x035c4680.
FAILURE: 0x6af9587ee0efe0b5 != 0x6af9587ee06fe0b5 at offset 0x03830680.
FAILURE: 0x6af9587ee0ffa0b5 != 0x6af9587ee07fa0b5 at offset 0x04010680.
FAILURE: 0x6af9587ee2aea8b5 != 0x6af9587ee22ea8b5 at offset 0x11794680.
FAILURE: 0x6af9587ee2aeb8b5 != 0x6af9587ee22eb8b5 at offset 0x1179c680.
FAILURE: 0x6af9587ee2ee38b5 != 0x6af9587ee26e38b5 at offset 0x1375c680.
FAILURE: 0x6af9587ee2ee58b5 != 0x6af9587ee26e58b5 at offset 0x1376c680.

[etc etc]

Block Sequential    : testing  42
FAILURE: 0x2a2a2a2a2a2a2a2a != 0x2a2a2a2a2aaa2a2a at offset 0x00334e78.
FAILURE: 0x2a2a2a2a2a2a2a2a != 0x2a2a2a2a2aaa2a2a at offset 0x00344e78.
FAILURE: 0x2a2a2a2a2a2a2a2a != 0x2a2a2a2a2aaa2a2a at offset 0x0034ce78.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x00a58680.
FAILURE: 0x2a2a2a2a2a2a2a2a != 0x2a2a2a2a2aaa2a2a at offset 0x00ec4e78.
FAILURE: 0x2a2a2a2a2a2a2a2a != 0x2a2a2a2a2aaa2a2a at offset 0x010bce78.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x013d4680.
FAILURE: 0x2a2a2a2a2a2a2a2a != 0x2a2a2a2a2aaa2a2a at offset 0x01634e78.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x0178c680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x01b38680.
FAILURE: 0x2a2a2a2a2a2a2a2a != 0x2a2a2a2a2aaa2a2a at offset 0x01bc4e78.
FAILURE: 0x2a2a2a2a2a2a2a2a != 0x2a2a2a2a2aaa2a2a at offset 0x01dbce78.
FAILURE: 0x2a2a2a2a2a2a2a2a != 0x2a2a2a2a2aaa2a2a at offset 0x01f74e78.
FAILURE: 0x2a2a2a2a2a2a2a2a != 0x2a2a2a2a2aaa2a2a at offset 0x021c4e78.
FAILURE: 0x2a2a2a2a2a2a2a2a != 0x2a2a2a2a2aaa2a2a at offset 0x027b4e78.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x027ec680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x02c10680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x02cb0680.
FAILURE: 0x2a2a2a2a2a2a2a2a != 0x2a2a2a2a2aaa2a2a at offset 0x02ffce78.
FAILURE: 0x2a2a2a2a2a2a2a2a != 0x2a2a2a2a2aaa2a2a at offset 0x0300ce78.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x035c4680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x04010680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x042bc680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x04394680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x044d0680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x044e4680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x04e34680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x0618c680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x06a6c680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x06aec680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x06e54680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x078ac680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x07dbc680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x07fac680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x08044680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x081cc680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x08224680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x08ed4680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x09254680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x098e4680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x099bc680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x09c24680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x0a5ac680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x0adc4680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x0b234680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x0b28c680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x0ba6c680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x0c834680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x0c83c680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x0c9e4680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x0ca74680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x0cd84680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x0cd8c680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x0d4d4680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x0d4dc680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x0d63c680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x0db24680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x0db2c680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x0e1f4680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x0e48c680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x0f5c4680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x0f964680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x0fd0c680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x0ff7c680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x106dc680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x10f3c680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x114a4680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x1179c680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x11b24680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x12524680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x12764680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x14664680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x1466c680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x14d14680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x16abc680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x16acc680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x175dc680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x17774680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x1777c680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x17dd4680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x17ddc680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x17de4680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x17dec680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x184fc680.
FAILURE: 0x2a2a2a2a2aaa2a2a != 0x2a2a2a2a2a2a2a2a at offset 0x1850c680.

[...]

  Bit Spread          : testing  23
FAILURE: 0xfffffffffd7fffff != 0xfffffffffdffffff at offset 0x00334e78.
FAILURE: 0xfffffffffd7fffff != 0xfffffffffdffffff at offset 0x0034ce78.
FAILURE: 0xfffffffffd7fffff != 0xfffffffffdffffff at offset 0x00eb4e78.
FAILURE: 0xfffffffffd7fffff != 0xfffffffffdffffff at offset 0x00ebce78.
FAILURE: 0xfffffffffd7fffff != 0xfffffffffdffffff at offset 0x00ec4e78.
FAILURE: 0xfffffffffd7fffff != 0xfffffffffdffffff at offset 0x00f54e78.
FAILURE: 0xfffffffffd7fffff != 0xfffffffffdffffff at offset 0x00f64e78.
FAILURE: 0xfffffffffd7fffff != 0xfffffffffdffffff at offset 0x015d4e78.
FAILURE: 0xfffffffffd7fffff != 0xfffffffffdffffff at offset 0x015e4e78.
FAILURE: 0xfffffffffd7fffff != 0xfffffffffdffffff at offset 0x018d4e78.
FAILURE: 0xfffffffffd7fffff != 0xfffffffffdffffff at offset 0x01bc4e78.
FAILURE: 0xfffffffffd7fffff != 0xfffffffffdffffff at offset 0x01dbce78.
FAILURE: 0xfffffffffd7fffff != 0xfffffffffdffffff at offset 0x01dc4e78.
FAILURE: 0xfffffffffd7fffff != 0xfffffffffdffffff at offset 0x01f74e78.
FAILURE: 0xfffffffffd7fffff != 0xfffffffffdffffff at offset 0x01f84e78.
FAILURE: 0xfffffffffd7fffff != 0xfffffffffdffffff at offset 0x021bce78.
FAILURE: 0xfffffffffd7fffff != 0xfffffffffdffffff at offset 0x021c4e78.
FAILURE: 0xfffffffffd7fffff != 0xfffffffffdffffff at offset 0x027b4e78.
FAILURE: 0xfffffffffd7fffff != 0xfffffffffdffffff at offset 0x027c4e78.
FAILURE: 0xfffffffffd7fffff != 0xfffffffffdffffff at offset 0x02ff4e78.
FAILURE: 0xfffffffffd7fffff != 0xfffffffffdffffff at offset 0x02ffce78.
FAILURE: 0xfffffffffd7fffff != 0xfffffffffdffffff at offset 0x04054e78.
FAILURE: 0xfffffffffd7fffff != 0xfffffffffdffffff at offset 0x06cd4e78.
FAILURE: 0xfffffffffd7fffff != 0xfffffffffdffffff at offset 0x18fa1e78.
FAILURE: 0xfffffffffd7fffff != 0xfffffffffdffffff at offset 0x19139e78.
FAILURE: 0xfffffffffd7fffff != 0xfffffffffdffffff at offset 0x191a2e78.
FAILURE: 0xfffffffffd7fffff != 0xfffffffffdffffff at offset 0x191fde78.

[...]

  Bit Flip            : testing 184
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x000dc680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x001f7680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x00456680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x008ae680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x00a58680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x00b82680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x00c5a680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x013d4680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0178c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x01884680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0189c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x01a9e680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x02c10680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x02cb0680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x02fdc680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0337c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x03480680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x035c4680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x03aac680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x03cf0680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x03d08680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x03eac680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x04010680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x04148680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x044d0680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x044e4680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x04e34680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x051e0680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0567c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0598c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x06164680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0618c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x06204680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x063d4680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x06a6c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x06ae4680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x06db4680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x07224680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0735c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x07654680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x078ac680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x07cbc680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x07e0c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x07fac680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x08094680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x081cc680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x08224680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x088fc680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x08a74680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x08b44680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x08ba4680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x08e0c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x08ed4680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x09254680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x092d4680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x09464680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x09c24680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0a334680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0a5ac680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0a684680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0a84c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0ad14680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0adc4680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0b234680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0b284680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0b2b4680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0b2bc680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0ba64680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0ba6c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0bbe4680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0bbec680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0c754680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0c75c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0c9e4680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0ca74680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0cd8c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0d4d4680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0d4dc680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0d634680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0d63c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0db2c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0e1a4680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0e1f4680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0e1fc680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0e294680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0e484680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0e48c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0eecc680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0f5c4680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0f964680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0f96c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0fd04680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0fd0c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0ff74680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x0ff7c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x105b4680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x10f34680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x11174680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x111a4680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x111ac680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x114a4680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x114ac680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x11574680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x11794680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x1210c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x1220c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x12524680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x1276c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x1375c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x13764680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x1376c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x144f4680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x144fc680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x14504680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x14654680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x1465c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x14664680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x1466c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x14d14680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x1631c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x1632c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x16ac4680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x16acc680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x175d4680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x175dc680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x175e4680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x17774680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x1777c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x1778c680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x17ddc680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x17de4680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x17dec680.
FAILURE: 0xffffffffffffffff != 0xffffffffff7fffff at offset 0x184f4680.

[Luke]

I only have 2x4GB RAM Rock64's at hand and both completed the test without issues (1st running 32 and the 2nd running 64bit OS images); same settings as the ones you used. Perhaps it only affects 2GB boards? 

I really hope more users will post results - especially from 1 and 2GB boards. 

[edit] in retrospect, I could have ran it as higher RAM capacity; will rerun tomorrow. 

32bit:

Code:

$ sudo memtester 810M
memtester version 4.3.0 (32-bit)
Copyright (C) 2001-2012 Charles Cazabon.
Licensed under the GNU General Public License version 2 (only).

pagesize is 4096
pagesizemask is 0xfffff000
want 810MB (849346560 bytes)
got  810MB (849346560 bytes), trying mlock ...locked.
Loop 1:
 Stuck Address       : ok        
 Random Value        : ok
 Compare XOR         : ok
 Compare SUB         : ok
 Compare MUL         : ok
 Compare DIV         : ok
 Compare OR          : ok
 Compare AND         : ok
 Sequential Increment: ok
 Solid Bits          : ok        
 Block Sequential    : ok        
 Checkerboard        : ok        
 Bit Spread          : ok        
 Bit Flip            : ok        
 Walking Ones        : ok        
 Walking Zeroes      : ok        
 8-bit Writes        : ok
 16-bit Writes       : ok

64bit:

Code:

rock64@rock64:~$ sudo memtester 810M
memtester version 4.3.0 (64-bit)
Copyright (C) 2001-2012 Charles Cazabon.
Licensed under the GNU General Public License version 2 (only).

pagesize is 4096
pagesizemask is 0xfffffffffffff000
want 810MB (849346560 bytes)
got  810MB (849346560 bytes), trying mlock ...locked.
Loop 1:
 Stuck Address       : ok        
 Random Value        : ok
 Compare XOR         : ok
 Compare SUB         : ok
 Compare MUL         : ok
 Compare DIV         : ok
 Compare OR          : ok
 Compare AND         : ok
 Sequential Increment: ok
 Solid Bits          : ok        
 Block Sequential    : ok        
 Checkerboard        : ok        
 Bit Spread          : ok        
 Bit Flip            : ok        
 Walking Ones        : ok        
 Walking Zeroes      : ok        
 8-bit Writes        : ok
 16-bit Writes       : ok

[belfastraven]

TO the OP here--how are you powering the devices that have memory problems? Could under-voltage be causing the problems, rather than something actually being wrong with the memory?

[z4v4l]

Normal firmware tests memory before happily reporting everything is OK and transfering control to OS. The question is was uboot doing its job? ARM here is not to blame. It's crap that pretends it is a normal firmware is. And of course, sellers of broken DRAM.
Original poster could ask for return/exchange.

[dkryder]

i ran remtester @ 256M just to make it short yet kinda thorough and  each loop was same as this on my 4GB board that was purchased @ start of sales. i bought it used ~2 weeks later by someone who felt it was less than what he had thought it was going to be. i think it is for the most part, like all earlier boards made by pine64, ok once the devs had some time to work with it.

Loop 256:
 Stuck Address       : ok        
 Random Value        : ok
 Compare XOR         : ok
 Compare SUB         : ok
 Compare MUL         : ok
 Compare DIV         : ok
 Compare OR          : ok
 Compare AND         : ok
 Sequential Increment: ok
 Solid Bits          : ok        
 Block Sequential    : ok        
 Checkerboard        : ok        
 Bit Spread          : ok        
 Bit Flip            : ok        
 Walking Ones        : ok        
 Walking Zeroes      : ok        
 8-bit Writes        : ok
 16-bit Writes       : ok

having posted all this it is apparent to me the OP  has a defective board and should open a ticket to return it under a warranty , if there is one. make mention of the thread on the ticket. good luck.

[prof7bit]

i ran remtester @ 256M [...] on my 4GB board

You only tested a tiny fraction of your RAM, you should run it at the maximum number it will allow (typically total RAM minus 200MB or so), please run it again to test all the remaining RAM also.

[Luke]

At 3GB RAM test I am still not seeing any errors on the 4GB boards. I have also ran a 1.5 test at 2GB RAM board and it was fine too. Hopefully this is just an odd issue or something to do with software.

[z4v4l]

You only tested a tiny fraction of your RAM, you should run it at the maximum number it will allow (typically total RAM minus 200MB or so), please run it again to test all the remaining RAM also.

at the OS level it's hard to test all the memory for obvious reasons, that's why it is done at the FW. it runs from SRAM and could check all the SDRAM.
Users should demand support of normal memory testing capabilities in current "kind of" firmware - uboot. In normal firmwares, if the strict test takes too long, for doing it every boot, there is an option - "memtest" as easy as it goes.
I don't get what the OP wants to accomplish collecting randomly test results from others? Most of them would be negative. It's an unfortunate event of having broken DRAM modules or poor soldering them. It's not "arm devices that make your ram broken". Ask for replacement.

[prof7bit]

> It's not "arm devices that make your ram broken". Ask for replacement.

Nobody said that it was ARM's fault.

> memtest


The memtest kernel option is not available on ayufan's kernel images (see the other thread in the linux sub forum). I build one myself with this config enabled, currently testing.

Replacement device arrived today, not yet tested, still testing the effects of the kernel memtest with the broken device to see if this might either help diagnosing such problems or even eliminate its effects entirely when the defective RAM is blacklisted.

---

A kernel built with CONFIG_MEMTEST=y
and the word memtest at the kernel command line shows this at boot:

I'm not sure if these are errors or just progress log, my desktop which shows something similar when booting with the memtest option (Ubuntu and Debian have all their kernel built with CONFIG_MEMTEST by default) although it does not have any errors with memtest86.

Code:

--($)-- dmesg                                                                                                                                                                  
[    0.000000] Booting Linux on physical CPU 0x0
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu    
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 4.4.114-rockchip-ayufan-1 (bernd@rock64-build-env) (gcc version 7.2.0 (Ubuntu/Linaro 7.2.0-6ubuntu1) ) #2 SMP Wed Mar 14 17:32:54 UTC 2018
[    0.000000] Boot CPU: AArch64 Processor [410fd034]
[    0.000000] early_memtest: # of tests: 17
[    0.000000]   0x0000000000200000 - 0x0000000002080000 pattern 4c494e5558726c7a
[    0.000000]   0x00000000033b7000 - 0x00000000033b8000 pattern 4c494e5558726c7a
[    0.000000]   0x00000000033b9000 - 0x000000003dc61000 pattern 4c494e5558726c7a
[    0.000000]   0x000000003dc70080 - 0x000000003dc73000 pattern 4c494e5558726c7a
[    0.000000]   0x000000003df016da - 0x000000003fff8000 pattern 4c494e5558726c7a    
[    0.000000]   0x000000003ffff000 - 0x0000000040000000 pattern 4c494e5558726c7a    
[    0.000000]   0x0000000000200000 - 0x0000000002080000 pattern eeeeeeeeeeeeeeee
[    0.000000]   0x00000000033b7000 - 0x00000000033b8000 pattern eeeeeeeeeeeeeeee
[    0.000000]   0x00000000033b9000 - 0x000000003dc61000 pattern eeeeeeeeeeeeeeee
[    0.000000]   0x000000003dc70080 - 0x000000003dc73000 pattern eeeeeeeeeeeeeeee
[    0.000000]   0x000000003df016da - 0x000000003fff8000 pattern eeeeeeeeeeeeeeee    
[    0.000000]   0x000000003ffff000 - 0x0000000040000000 pattern eeeeeeeeeeeeeeee    
[    0.000000]   0x0000000000200000 - 0x0000000002080000 pattern dddddddddddddddd
[    0.000000]   0x00000000033b7000 - 0x00000000033b8000 pattern dddddddddddddddd
[    0.000000]   0x00000000033b9000 - 0x000000003dc61000 pattern dddddddddddddddd
[    0.000000]   0x000000003dc70080 - 0x000000003dc73000 pattern dddddddddddddddd
[    0.000000]   0x000000003df016da - 0x000000003fff8000 pattern dddddddddddddddd
[    0.000000]   0x000000003ffff000 - 0x0000000040000000 pattern dddddddddddddddd
[    0.000000]   0x0000000000200000 - 0x0000000002080000 pattern bbbbbbbbbbbbbbbb
[    0.000000]   0x00000000033b7000 - 0x00000000033b8000 pattern bbbbbbbbbbbbbbbb
[    0.000000]   0x00000000033b9000 - 0x000000003dc61000 pattern bbbbbbbbbbbbbbbb
[    0.000000]   0x000000003dc70080 - 0x000000003dc73000 pattern bbbbbbbbbbbbbbbb
[    0.000000]   0x000000003df016da - 0x000000003fff8000 pattern bbbbbbbbbbbbbbbb
[    0.000000]   0x000000003ffff000 - 0x0000000040000000 pattern bbbbbbbbbbbbbbbb
[    0.000000]   0x0000000000200000 - 0x0000000002080000 pattern 7777777777777777
[    0.000000]   0x00000000033b7000 - 0x00000000033b8000 pattern 7777777777777777
[    0.000000]   0x00000000033b9000 - 0x000000003dc61000 pattern 7777777777777777
[    0.000000]   0x000000003dc70080 - 0x000000003dc73000 pattern 7777777777777777
[    0.000000]   0x000000003df016da - 0x000000003fff8000 pattern 7777777777777777
[    0.000000]   0x000000003ffff000 - 0x0000000040000000 pattern 7777777777777777
[    0.000000]   0x0000000000200000 - 0x0000000002080000 pattern cccccccccccccccc
[    0.000000]   0x00000000033b7000 - 0x00000000033b8000 pattern cccccccccccccccc
[    0.000000]   0x00000000033b9000 - 0x000000003dc61000 pattern cccccccccccccccc
[    0.000000]   0x000000003dc70080 - 0x000000003dc73000 pattern cccccccccccccccc
[    0.000000]   0x000000003df016da - 0x000000003fff8000 pattern cccccccccccccccc
[    0.000000]   0x000000003ffff000 - 0x0000000040000000 pattern cccccccccccccccc
[    0.000000]   0x0000000000200000 - 0x0000000002080000 pattern 9999999999999999
[    0.000000]   0x00000000033b7000 - 0x00000000033b8000 pattern 9999999999999999
[    0.000000]   0x00000000033b9000 - 0x000000003dc61000 pattern 9999999999999999
[    0.000000]   0x000000003dc70080 - 0x000000003dc73000 pattern 9999999999999999
[    0.000000]   0x000000003df016da - 0x000000003fff8000 pattern 9999999999999999
[    0.000000]   0x000000003ffff000 - 0x0000000040000000 pattern 9999999999999999
[    0.000000]   0x0000000000200000 - 0x0000000002080000 pattern 6666666666666666
[    0.000000]   0x00000000033b7000 - 0x00000000033b8000 pattern 6666666666666666
[    0.000000]   0x00000000033b9000 - 0x000000003dc61000 pattern 6666666666666666
[    0.000000]   0x000000003dc70080 - 0x000000003dc73000 pattern 6666666666666666
[    0.000000]   0x000000003df016da - 0x000000003fff8000 pattern 6666666666666666
[    0.000000]   0x000000003ffff000 - 0x0000000040000000 pattern 6666666666666666
[    0.000000]   0x0000000000200000 - 0x0000000002080000 pattern 3333333333333333
[    0.000000]   0x00000000033b7000 - 0x00000000033b8000 pattern 3333333333333333
[    0.000000]   0x00000000033b9000 - 0x000000003dc61000 pattern 3333333333333333
[    0.000000]   0x000000003dc70080 - 0x000000003dc73000 pattern 3333333333333333
[    0.000000]   0x000000003df016da - 0x000000003fff8000 pattern 3333333333333333
[    0.000000]   0x000000003ffff000 - 0x0000000040000000 pattern 3333333333333333
[    0.000000]   0x0000000000200000 - 0x0000000002080000 pattern 8888888888888888
[    0.000000]   0x00000000033b7000 - 0x00000000033b8000 pattern 8888888888888888
[    0.000000]   0x00000000033b9000 - 0x000000003dc61000 pattern 8888888888888888
[    0.000000]   0x000000003dc70080 - 0x000000003dc73000 pattern 8888888888888888
[    0.000000]   0x000000003df016da - 0x000000003fff8000 pattern 8888888888888888
[    0.000000]   0x000000003ffff000 - 0x0000000040000000 pattern 8888888888888888
[    0.000000]   0x0000000000200000 - 0x0000000002080000 pattern 4444444444444444
[    0.000000]   0x00000000033b7000 - 0x00000000033b8000 pattern 4444444444444444
[    0.000000]   0x00000000033b9000 - 0x000000003dc61000 pattern 4444444444444444
[    0.000000]   0x000000003dc70080 - 0x000000003dc73000 pattern 4444444444444444
[    0.000000]   0x000000003df016da - 0x000000003fff8000 pattern 4444444444444444
[    0.000000]   0x000000003ffff000 - 0x0000000040000000 pattern 4444444444444444
[    0.000000]   0x0000000000200000 - 0x0000000002080000 pattern 2222222222222222
[    0.000000]   0x00000000033b7000 - 0x00000000033b8000 pattern 2222222222222222
[    0.000000]   0x00000000033b9000 - 0x000000003dc61000 pattern 2222222222222222
[    0.000000]   0x000000003dc70080 - 0x000000003dc73000 pattern 2222222222222222
[    0.000000]   0x000000003df016da - 0x000000003fff8000 pattern 2222222222222222
[    0.000000]   0x000000003ffff000 - 0x0000000040000000 pattern 2222222222222222
[    0.000000]   0x0000000000200000 - 0x0000000002080000 pattern 1111111111111111
[    0.000000]   0x00000000033b7000 - 0x00000000033b8000 pattern 1111111111111111
[    0.000000]   0x00000000033b9000 - 0x000000003dc61000 pattern 1111111111111111
[    0.000000]   0x000000003dc70080 - 0x000000003dc73000 pattern 1111111111111111
[    0.000000]   0x000000003df016da - 0x000000003fff8000 pattern 1111111111111111
[    0.000000]   0x000000003ffff000 - 0x0000000040000000 pattern 1111111111111111
[    0.000000]   0x0000000000200000 - 0x0000000002080000 pattern aaaaaaaaaaaaaaaa
[    0.000000]   0x00000000033b7000 - 0x00000000033b8000 pattern aaaaaaaaaaaaaaaa
[    0.000000]   0x00000000033b9000 - 0x000000003dc61000 pattern aaaaaaaaaaaaaaaa
[    0.000000]   0x000000003dc70080 - 0x000000003dc73000 pattern aaaaaaaaaaaaaaaa
[    0.000000]   0x000000003df016da - 0x000000003fff8000 pattern aaaaaaaaaaaaaaaa
[    0.000000]   0x000000003ffff000 - 0x0000000040000000 pattern aaaaaaaaaaaaaaaa
[    0.000000]   0x0000000000200000 - 0x0000000002080000 pattern 5555555555555555
[    0.000000]   0x00000000033b7000 - 0x00000000033b8000 pattern 5555555555555555
[    0.000000]   0x00000000033b9000 - 0x000000003dc61000 pattern 5555555555555555
[    0.000000]   0x000000003dc70080 - 0x000000003dc73000 pattern 5555555555555555
[    0.000000]   0x000000003df016da - 0x000000003fff8000 pattern 5555555555555555
[    0.000000]   0x000000003ffff000 - 0x0000000040000000 pattern 5555555555555555
[    0.000000]   0x0000000000200000 - 0x0000000002080000 pattern ffffffffffffffff
[    0.000000]   0x00000000033b7000 - 0x00000000033b8000 pattern ffffffffffffffff
[    0.000000]   0x00000000033b9000 - 0x000000003dc61000 pattern ffffffffffffffff
[    0.000000]   0x000000003dc70080 - 0x000000003dc73000 pattern ffffffffffffffff
[    0.000000]   0x000000003df016da - 0x000000003fff8000 pattern ffffffffffffffff
[    0.000000]   0x000000003ffff000 - 0x0000000040000000 pattern ffffffffffffffff
[    0.000000]   0x0000000000200000 - 0x0000000002080000 pattern 0000000000000000
[    0.000000]   0x00000000033b7000 - 0x00000000033b8000 pattern 0000000000000000
[    0.000000]   0x00000000033b9000 - 0x000000003dc61000 pattern 0000000000000000
[    0.000000]   0x000000003dc70080 - 0x000000003dc73000 pattern 0000000000000000
[    0.000000]   0x000000003df016da - 0x000000003fff8000 pattern 0000000000000000
[    0.000000]   0x000000003ffff000 - 0x0000000040000000 pattern 0000000000000000

It takes 5 minutes to boot with memtest but afterwards memtester still shows a ton of bad RAM and file copy still corrupts files.

We need a reliable tool to test all RAM, an equivalent of memtest86 and the kernel memtest does not seem to be effective at all, on my desktop it finds false positives and on this Rock64 it does not detect and blacklist even half of the bad memory.

---

Looking at the source of linux/mm/memtest.c it should have printed

pr_info("  %016llx bad mem addr %pa - %pa reserved\n",

and the output I saw in the dmesg is only progress messages. So this means kernel memtest took 5 minutes to find nothing! while memtester almost immediately spew out tons of errors.

I'm now testing the replacement device. My original was 1GB and the vendor sent me a replacement device with 2GB. Same output from kernel memtest (only progress log and otherwise nothing) and userspace memtester still running, no errors so far.

I wonder why did the built in memtest not detect even a single one of these errors in my old device?

[z4v4l]

I wonder why did the built in memtest not detect even a single one of these errors in my old device?

maybe because it's a bad memtest? i honestly don't know anything about the internal linux memtester, maybe it misses the bad holes, - test zones don't occupy bad pages accidentally. Are they random? If so, after several times, it should overlap with at least one bad page, given how numerous they are. (I really hope the internal tester isn't so dumb to just read back data from cache ).
But if you got many times bad memtest results it means either broken tester or broken memory. Since the former works fine for others, you've got the answer. I hope your new board is OK.