Performance and stability issues Openmediavault
#1
I have been running a OMV on a HC1, XU4 and now Rock64.  I decided to do performance comparisons.  This then exposed my instability issue with Rock64.  The HC1 gave 110 MB/s write speed.  The XU4 only did 70 MB/s.  The Rock64 might be the star I thought but it only did about 80 MB/s before it crashed.  This now is the problem.

I try coping about 10 GBs from W10 to the Rock64 via ethernet and it fails every time at around 6 GBs. The box crashes and must be power cycled.  There is no message in the OMV log.  Smaller copies work and if I connect my USB 3.0 attached HDD to the USB 2 port the copy works but at 30 MB/s.

I have tried a HDD, a SSD and a M.2 SSD in a M.2 to USB enclosure. All 3 fail approximately the same. Makes me think the load is crashing something.  
One error in the log I see occasionally is something like  Fatal  Watchdog not found.  
I am running OMV 4.1.11  Linux version 4.4.132 on the eMMC.  I have the correct power supply.

Anyone have any ideas on this problems?  What other testing could I do to trap some meaningful error messages? 
Thanks
Joep
#2
(09-24-2018, 09:26 PM)jgpacc Wrote: I have been running a OMV on a HC1, XU4 and now Rock64.  I decided to do performance comparisons.  This then exposed my instability issue with Rock64.  The HC1 gave 110 MB/s write speed.  The XU4 only did 70 MB/s.  The Rock64 might be the star I thought but it only did about 80 MB/s before it crashed.  This now is the problem.

I try coping about 10 GBs from W10 to the Rock64 via ethernet and it fails every time at around 6 GBs. The box crashes and must be power cycled.  There is no message in the OMV log.  Smaller copies work and if I connect my USB 3.0 attached HDD to the USB 2 port the copy works but at 30 MB/s.

I have tried a HDD, a SSD and a M.2 SSD in a M.2 to USB enclosure. All 3 fail approximately the same. Makes me think the load is crashing something.  
One error in the log I see occasionally is something like  Fatal  Watchdog not found.  
I am running OMV 4.1.11  Linux version 4.4.132 on the eMMC.  I have the correct power supply.

Anyone have any ideas on this problems?  What other testing could I do to trap some meaningful error messages? 
Thanks
Joep

Im using ATM OMV on rock64 installed from an image downloaded from here and its working fine, no matter what file size, if all disks you use are connected with the same enclosure then maybe there are compatibility issues, i cant find the post from tkaiser on the armbian forum where he analized external hdd enclosure/adapter chipsets but basically a lot of those where unstable to say the least and its not a rock64 or omv fault, on most cases he solve the problems by disabling UAS wich in fact is disabled by default on the build from the link i posted for allmost all adapters exept the ones they know that work...

Also for most SBC OMV builds they have a plugin enabled by default (openmediavault-flashmemory) that basically dont write logs on disk, only on memory, its kinda hard to analyze if the device crash completelly, i never tried it but disabling that addon you can maybe get actual disk logs that can help after a major crash...(i never try it, do your googling)

TLDR: try disabling UAS on the disk, check if there is no temperature problem, both on the rock64 and the hdd enclosure/adapter, disable the flashmemory plugin for proper logs
#3
Thanks for your response.  I tried the image you suggested but that wont even boot.  I get what I would call stack dumps to the terminal.  I can catch a few lines here and there talking about stack loop lockup bla bla CPU 3.
Stops for 90 seconds and starts again.  I tried it on eMMC and SD card.

Going to see if I can reinstall the image I had working.  Maybe the board gave up
#4
(09-25-2018, 11:47 AM)jgpacc Wrote: Thanks for your response.  I tried the image you suggested but that wont even boot.  I get what I would call stack dumps to the terminal.  I can catch a few lines here and there talking about stack loop lockup bla bla CPU 3.
Stops for 90 seconds and starts again.  I tried it on eMMC and SD card.

Going to see if I can reinstall the image I had working.  Maybe the board gave up

Are you sure you downloaded the rock64 image? because it worked for me perfectly, what program do you use to write to SD card? i usually use etcher and works wonder, any other gives me mixed results but etcher works for me all the time...
#5
(09-25-2018, 12:43 PM)Trash_Can_Man Wrote:
(09-25-2018, 11:47 AM)jgpacc Wrote: Thanks for your response.  I tried the image you suggested but that wont even boot.  I get what I would call stack dumps to the terminal.  I can catch a few lines here and there talking about stack loop lockup bla bla CPU 3.
Stops for 90 seconds and starts again.  I tried it on eMMC and SD card.

Going to see if I can reinstall the image I had working.  Maybe the board gave up

Are you sure you downloaded the rock64 image? because it worked for me perfectly, what program do you use to write to SD card? i usually use etcher and works wonder, any other gives me mixed results but etcher works for me all the time...
Yes I am using OMV_4_Rock64.  But I gave up on Etcher a while ago because I keep getting that "Couldn't clean the drive, Command Failed: diskpart /s"   So I use DiskFormatter and Win32diskimager
I
#6
(09-25-2018, 05:43 PM)jgpacc Wrote:
(09-25-2018, 12:43 PM)Trash_Can_Man Wrote:
(09-25-2018, 11:47 AM)jgpacc Wrote: Thanks for your response.  I tried the image you suggested but that wont even boot.  I get what I would call stack dumps to the terminal.  I can catch a few lines here and there talking about stack loop lockup bla bla CPU 3.
Stops for 90 seconds and starts again.  I tried it on eMMC and SD card.

Going to see if I can reinstall the image I had working.  Maybe the board gave up

Are you sure you downloaded the rock64 image? because it worked for me perfectly, what program do you use to write to SD card? i usually use etcher and works wonder, any other gives me mixed results but etcher works for me all the time...
Yes I am using OMV_4_Rock64.  But I gave up on Etcher a while ago because I keep getting that "Couldn't clean the drive, Command Failed: diskpart /s"   So I use DiskFormatter and Win32diskimager
I

Well anyway if your method works with the same image i linked and it boots and all but you have instability IMO the problem is somewhere else...your rock64 have at the very least a heatsink? your enclosures/adapters have UAS enabled? did you try to disable it? if you have tried all this im out of ideas...
#7
(09-25-2018, 07:36 PM)Trash_Can_Man Wrote:
(09-25-2018, 05:43 PM)jgpacc Wrote:
(09-25-2018, 12:43 PM)Trash_Can_Man Wrote:
(09-25-2018, 11:47 AM)jgpacc Wrote: Thanks for your response.  I tried the image you suggested but that wont even boot.  I get what I would call stack dumps to the terminal.  I can catch a few lines here and there talking about stack loop lockup bla bla CPU 3.
Stops for 90 seconds and starts again.  I tried it on eMMC and SD card.

Going to see if I can reinstall the image I had working.  Maybe the board gave up

Are you sure you downloaded the rock64 image? because it worked for me perfectly, what program do you use to write to SD card? i usually use etcher and works wonder, any other gives me mixed results but etcher works for me all the time...
Yes I am using OMV_4_Rock64.  But I gave up on Etcher a while ago because I keep getting that "Couldn't clean the drive, Command Failed: diskpart /s"   So I use DiskFormatter and Win32diskimager
I

Well anyway if your method works with the same image i linked and it boots and all but you have instability IMO the problem is somewhere else...your rock64 have at the very least a heatsink? your enclosures/adapters have UAS enabled? did you try to disable it? if you have tried all this im out of ideas...
I am beginning to think something more fundamental is going on.  I can not boot with the link you gave me.  It just dumps every 90 seconds.  I installed my original  strech-openmediavault-rock64-0.7.8-1061-arm64 from the wiki.  it boots and runs for a while than crash.  I did get some messages in the log that looked significat.  Looking for modules on the emmc drive it could not find.  But funny they were there in the prior boot.  So maybe the eMMC is bad, but it does the same on SD card.  Maybe the board is just bad.  

I don't know how to disable UAS but I will look around.  I will try that over the next few days.
Thanks for your help.
#8
(09-26-2018, 02:08 PM)jgpacc Wrote:
(09-25-2018, 07:36 PM)Trash_Can_Man Wrote:
(09-25-2018, 05:43 PM)jgpacc Wrote:
(09-25-2018, 12:43 PM)Trash_Can_Man Wrote:
(09-25-2018, 11:47 AM)jgpacc Wrote: Thanks for your response.  I tried the image you suggested but that wont even boot.  I get what I would call stack dumps to the terminal.  I can catch a few lines here and there talking about stack loop lockup bla bla CPU 3.
Stops for 90 seconds and starts again.  I tried it on eMMC and SD card.

Going to see if I can reinstall the image I had working.  Maybe the board gave up

Are you sure you downloaded the rock64 image? because it worked for me perfectly, what program do you use to write to SD card? i usually use etcher and works wonder, any other gives me mixed results but etcher works for me all the time...
Yes I am using OMV_4_Rock64.  But I gave up on Etcher a while ago because I keep getting that "Couldn't clean the drive, Command Failed: diskpart /s"   So I use DiskFormatter and Win32diskimager
I

Well anyway if your method works with the same image i linked and it boots and all but you have instability IMO the problem is somewhere else...your rock64 have at the very least a heatsink? your enclosures/adapters have UAS enabled? did you try to disable it? if you have tried all this im out of ideas...
I am beginning to think something more fundamental is going on.  I can not boot with the link you gave me.  It just dumps every 90 seconds.  I installed my original  strech-openmediavault-rock64-0.7.8-1061-arm64 from the wiki.  it boots and runs for a while than crash.  I did get some messages in the log that looked significat.  Looking for modules on the emmc drive it could not find.  But funny they were there in the prior boot.  So maybe the eMMC is bad, but it does the same on SD card.  Maybe the board is just bad.  

I don't know how to disable UAS but I will look around.  I will try that over the next few days.
Thanks for your help.

Anyway UAS affects external drives only, not EMMC/SD, start looking at that and give another chance to Etcher, maybe...and again, do you have installed a heatsink? made a real difference on my board with stability...anyway, keep us updated of your findings...
#9
(09-26-2018, 04:01 PM)Trash_Can_Man Wrote:
(09-26-2018, 02:08 PM)jgpacc Wrote:
(09-25-2018, 07:36 PM)Trash_Can_Man Wrote:
(09-25-2018, 05:43 PM)jgpacc Wrote:
(09-25-2018, 12:43 PM)Trash_Can_Man Wrote: Are you sure you downloaded the rock64 image? because it worked for me perfectly, what program do you use to write to SD card? i usually use etcher and works wonder, any other gives me mixed results but etcher works for me all the time...
Yes I am using OMV_4_Rock64.  But I gave up on Etcher a while ago because I keep getting that "Couldn't clean the drive, Command Failed: diskpart /s"   So I use DiskFormatter and Win32diskimager
I

Well anyway if your method works with the same image i linked and it boots and all but you have instability IMO the problem is somewhere else...your rock64 have at the very least a heatsink? your enclosures/adapters have UAS enabled? did you try to disable it? if you have tried all this im out of ideas...
I am beginning to think something more fundamental is going on.  I can not boot with the link you gave me.  It just dumps every 90 seconds.  I installed my original  strech-openmediavault-rock64-0.7.8-1061-arm64 from the wiki.  it boots and runs for a while than crash.  I did get some messages in the log that looked significat.  Looking for modules on the emmc drive it could not find.  But funny they were there in the prior boot.  So maybe the eMMC is bad, but it does the same on SD card.  Maybe the board is just bad.  

I don't know how to disable UAS but I will look around.  I will try that over the next few days.
Thanks for your help.

Anyway UAS affects external drives only, not EMMC/SD, start looking at that and give another chance to Etcher, maybe...and again, do you have installed a heatsink? made a real difference on my board with stability...anyway, keep us updated of your findings...

I have done many many tests and nothing made sense. I found most of the images for Rock64 are not stable or just dont work/dont boot. Didn't think that was right.  So when you have tested every thing else and the only thing remaining no matter how unlikely has to be the problem.  Power supply.
So I order a new power supply. I got the same one I already had.  and like magic all problems went away. Angry 

I get new SD cards, new USB to SD writer, yes another Rock64.  Finally the last thing I got was another power suppy.

So it is up and running in its cool little Rock64 al. case  (which by the way heat sink does not contact the CPU the way it comes you need a very thick thermal pad)  Runs at 45c idle and 55-60c under heavy backup process.

Only issue remaing is 65/MBS vs 110/MBS for Odroid HC1.  For another day.

Thanks!
#10
I have the same problem with watchdog on usb external devices..!!! So true.!

This mini computer has issues beyond repairing..!!! So disappointing. I tried the image from the original site.


Possibly Related Threads…
Thread Author Replies Views Last Post
Question Hardware issues with Rock64 grobbs 11 1,811 Yesterday, 10:23 AM
Last Post: robinkyle11
  Rock64 Long Term stability ramprasad 4 2,022 03-16-2021, 07:23 PM
Last Post: Rocklobster
  Rock64 v2 as Openmediavault server - buffers / shutdown problems helpmerock 2 1,213 12-29-2020, 09:46 AM
Last Post: helpmerock
Information NAS / OpenMediaVault pfeerick 48 49,013 08-06-2020, 10:54 PM
Last Post: iscmob
  Rock64 v2 network issues alephnull 2 2,448 05-29-2020, 06:00 AM
Last Post: maccarry
  Heat issues admiral_andersen 5 1,981 11-04-2019, 11:52 AM
Last Post: Rocklobster
  Better performance larj 10 4,535 03-21-2019, 09:13 PM
Last Post: onfire4g05
  Video playback performance va88 0 1,066 12-19-2018, 01:19 PM
Last Post: va88
  Odd HDMI issues jman005 0 749 10-26-2018, 09:15 PM
Last Post: jman005
  Lakka poor performance experience Danielsan 2 1,872 02-17-2018, 07:32 PM
Last Post: Danielsan

Forum Jump:


Users browsing this thread: 1 Guest(s)