09-11-2023, 12:30 PM
Hey! Since I have gotten my RockPro64 to use as a NAS, I have constantly experienced crashes when transferring large folders (mostly game files). A particular example which always causes crashes is my modded ARK install, spanning 160GB in 110000 files and 8000 folders.
When transferring said folder over rsync, both local or over the network, one of the next cases appears about 2-10 GB into the download:
When trying to rule down the problem, I found out that
The issue mostly appears when transferring computer games. The ARK folder never completed transferring, but some smaller (20-40GB) games did (although inconsistently) when transferred at lower speeds, e.g. over the network or to/from an HDD. I also tried to tar the folder, both on my laptop before transferring over the network, and locally when plugging the drive to the rockpro64. The system still experienced crashes.
Interestingly, I also tried sending my laptops /dev/urandom over netcat to the NAS, which never crashed it, not even after reaching the 100GB mark and at high speeds.
Now, half a year after trying to use my rockpro64 as a NAS, I am truly clueless about the nature of this problem. I really don't know what to try to diagnose next.
Below you can find journald entries of the kernel oopses and hung processes. I don't seem to be able to upload pictures of FreeBSD kernel panics due to image size.
I hope that someone has a clue about what may be going on on my system.
Journal log
When transferring said folder over rsync, both local or over the network, one of the next cases appears about 2-10 GB into the download:
- rsync crashes and the download stops (this sometimes shows a message in the kmsg about hung processes)
- the kernel throws an "Oops", which seems to be always different although I do not have the skills to debug it
- the kernel just panics
- the entire system just freezes up, with no panic or other indication visible on my HDMI monitor
- the entire system just resets
When trying to rule down the problem, I found out that
- it's not a filesystem problem, it occurs on btrfs, ext4, zfs on linux and zfs on freebsd
- it's not a hard drive problem, I tested two HDDs and one SSD
- it's not a SATA controller problem, it occurs both on my PCIe card and on a USB adapter
- it's not a network card problem, running iperf for long periods of time is fine
- it's probably not a ram problem, I ran `memtest` with the highest value I could give it and I ran a MemTest86 test
- it's not a linux distro (I was using Debian 11 and 12) problem or a linux kernel problem, the issues occur in a similar manner on FreeBSD
- it's not a problem with my laptop's hard drive (or with the files, whatever that may be), I can transfer the folder onto different x86 machines
The issue mostly appears when transferring computer games. The ARK folder never completed transferring, but some smaller (20-40GB) games did (although inconsistently) when transferred at lower speeds, e.g. over the network or to/from an HDD. I also tried to tar the folder, both on my laptop before transferring over the network, and locally when plugging the drive to the rockpro64. The system still experienced crashes.
Interestingly, I also tried sending my laptops /dev/urandom over netcat to the NAS, which never crashed it, not even after reaching the 100GB mark and at high speeds.
Now, half a year after trying to use my rockpro64 as a NAS, I am truly clueless about the nature of this problem. I really don't know what to try to diagnose next.
Below you can find journald entries of the kernel oopses and hung processes. I don't seem to be able to upload pictures of FreeBSD kernel panics due to image size.
I hope that someone has a clue about what may be going on on my system.
Journal log