Pine64 Debian Stretch/mainline [4.14.7]

[alaric]

Hi,

I've downloaded your latest img and busy trying it on my Pine64 1GB dev kit (A64-DB-RevB 2016-02-24). If I leave it idle after a while I get the following:
The board continues running after, any suggestions what may be causing this?

[19948082.537437] INFO: rcu_sched detected stalls on CPUs/tasks:
[19948082.543199]       0-...: (0 ticks this GP) idle=ee2/140000000000000/0 softirq=5348379/5348379 fqs=103
[19948082.552314]       (detected by 3, t=103342 jiffies, g=3187758, c=3187757, q=895)
[19948082.559529] Task dump for CPU 0:
[19948082.563011] swapper/0       R  running task        0     0      0 0x00000002
[19948082.570312] Call trace:
[19948082.573027] [<ffff000008084d20>] __switch_to+0x90/0xa8
[19948082.578423] [<ffff0000080c3d50>] update_rq_clock.part.6+0x18/0x40
[19948082.584768] [<ffff0000080c4974>] update_rq_clock+0x1c/0x28
[19948082.590508] [<ffff0000080cf268>] cpu_load_update_nohz_stop+0x98/0xa0
[19948082.597115] [<ffff0000081070b8>] tick_nohz_idle_exit+0x80/0x170
[19948082.603288] [<ffff0000080d894c>] do_idle+0xa4/0x1a8
[19948082.608421] [<ffff0000080d8bbc>] cpu_startup_entry+0x24/0x28
[19948082.614337] [<ffff0000086adfac>] rest_init+0xb4/0xc0
[19948082.619559] [<ffff0000088f0b34>] start_kernel+0x36c/0x380
[19948082.625211] [<ffff0000088f01e0>] __primary_switched+0x64/0x6c
[19948082.631211] rcu_sched kthread starved for 99491 jiffies! g3187758 c3187757 f0x0 RCU_GP_WAIT_FQS(3) ->state=0x1
[19948082.641454] rcu_sched       S    0     8      2 0x00000000
[19948082.647193] Call trace:
[19948082.649898] [<ffff000008084d20>] __switch_to+0x90/0xa8
[19948082.655291] [<ffff0000086af164>] __schedule+0x194/0x5b8
[19948082.660769] [<ffff0000086af5b4>] schedule+0x2c/0x88
[19948082.665903] [<ffff0000086b25ac>] schedule_timeout+0x134/0x288
[19948082.671903] [<ffff0000080f2fac>] rcu_gp_kthread+0x464/0x748
[19948082.677730] [<ffff0000080be514>] kthread+0xfc/0x128
[19948082.682861] [<ffff000008082ec0>] ret_from_fork+0x10/0x50
[19948952.405438] INFO: rcu_sched self-detected stall on CPU
[19948952.410852]       1-...: (1 ticks this GP) idle=15a/1/0 softirq=1066178/1066178 fqs=0
[19948952.418580]        (t=183611 jiffies g=3190431 c=3190430 q=0)
[19948952.424152] rcu_sched kthread starved for 183611 jiffies! g3190431 c3190430 f0x0 RCU_GP_WAIT_FQS(3) ->state=0x1
[19948952.434482] rcu_sched       S    0     8      2 0x00000000
[19948952.440222] Call trace:
[19948952.442937] [<ffff000008084d20>] __switch_to+0x90/0xa8
[19948952.448333] [<ffff0000086af164>] __schedule+0x194/0x5b8
[19948952.453811] [<ffff0000086af5b4>] schedule+0x2c/0x88
[19948952.458946] [<ffff0000086b25ac>] schedule_timeout+0x134/0x288
[19948952.464946] [<ffff0000080f2fac>] rcu_gp_kthread+0x464/0x748
[19948952.470772] [<ffff0000080be514>] kthread+0xfc/0x128
[19948952.475903] [<ffff000008082ec0>] ret_from_fork+0x10/0x50
[19948952.481470] Task dump for CPU 0:
[19948952.484952] swapper/0       R  running task        0     0      0 0x00000000
[19948952.492251] Call trace:
[19948952.494957] [<ffff000008084d20>] __switch_to+0x90/0xa8
[19948952.500351] [<ffff000008968000>] page_wait_table+0x1280/0x1800
[19948952.505430] INFO: rcu_sched self-detected stall on CPU
[19948952.505439]       2-...: (10 GPs behind) idle=306/1/0 softirq=3617177/3617177 fqs=0
[19948952.505440]        (t=183611 jiffies g=3190431 c=3190430 q=1)
[19948952.505449] rcu_sched kthread starved for 183611 jiffies! g3190431 c3190430 f0x0 RCU_GP_WAIT_FQS(3) ->state=0x0
[19948952.505451] rcu_sched       R  running task        0     8      2 0x00000000
[19948952.505457] Call trace:
[19948952.505464] [<ffff000008084d20>] __switch_to+0x90/0xa8
[19948952.505470] [<ffff0000086af164>] __schedule+0x194/0x5b8
[19948952.505476] [<ffff0000086af5b4>] schedule+0x2c/0x88
[19948952.505482] [<ffff0000086b25ac>] schedule_timeout+0x134/0x288
[19948952.505488] [<ffff0000080f2fac>] rcu_gp_kthread+0x464/0x748
[19948952.505493] [<ffff0000080be514>] kthread+0xfc/0x128
[19948952.505498] [<ffff000008082ec0>] ret_from_fork+0x10/0x50
[19948952.583725] Task dump for CPU 1:
[19948952.587206] swapper/1       R  running task        0     0      1 0x00000002
[19948952.594506] Call trace:
[19948952.597211] [<ffff000008088098>] dump_backtrace+0x0/0x210
[19948952.602864] [<ffff0000080882fc>] show_stack+0x14/0x20
[19948952.608170] [<ffff0000080c8374>] sched_show_task+0x10c/0x170
[19948952.614084] [<ffff0000080c91e0>] dump_cpu_task+0x40/0x50
[19948952.619649] [<ffff0000080f44b4>] rcu_dump_cpu_stacks+0x94/0xe0
[19948952.625734] [<ffff0000080f3c1c>] rcu_check_callbacks+0x644/0x808
[19948952.631995] [<ffff0000080f7eec>] update_process_times+0x2c/0x58
[19948952.638168] [<ffff000008106e18>] tick_sched_handle.isra.5+0x30/0x50
[19948952.644687] [<ffff000008106e78>] tick_sched_timer+0x40/0x90
[19948952.650511] [<ffff0000080f8a60>] __hrtimer_run_queues+0xe8/0x160
[19948952.656769] [<ffff0000080f8cf0>] hrtimer_interrupt+0xa0/0x220
[19948952.662770] [<ffff000008578210>] arch_timer_handler_phys+0x30/0x40
[19948952.669203] [<ffff0000080e8490>] handle_percpu_devid_irq+0x78/0x130
[19948952.675724] [<ffff0000080e2eec>] generic_handle_irq+0x24/0x38
[19948952.681723] [<ffff0000080e3564>] __handle_domain_irq+0x5c/0xb8
[19948952.687808] [<ffff000008081528>] gic_handle_irq+0x58/0xb0
[19948952.693458] Exception stack(0xffff80003a89fe20 to 0xffff80003a89ff50)
[19948952.700150] fe20: 0000000000000000 0000000000000000 0000000000000001 0000000000000000
[19948952.708229] fe40: 0000000000000000 0000800033644000 0000000000000001 00000000000001c0
[19948952.716307] fe60: 0000000000000002 ffff80003a89fec0 0000000000000980 ffff80003a855f80
[19948952.724385] fe80: 0000000000000000 0046df776d4a8070 0034ac869de58d00 0000000000000000
[19948952.732462] fea0: ffff0000082026d0 0000ffff7f50de18 0000000000000035 ffff00000894e000
[19948952.740540] fec0: ffff000008968b30 ffff000008968000 ffff000008959078 0000000000000000
[19948952.748618] fee0: 0000000000000000 ffff80003a890d80 0000000000000000 0000000000000000
[19948952.756696] ff00: 0000000000000000 ffff80003a89ff50 ffff00000808485c ffff80003a89ff50
[19948952.764774] ff20: ffff000008084860 0000000000000145 0000000000000000 ffff0000080d8954
[19948952.772850] ff40: ffffffffffffffff 7fffffffffffffff
[19948952.777981] [<ffff0000080827f4>] el1_irq+0xb4/0x140
[19948952.783113] [<ffff000008084860>] arch_cpu_idle+0x10/0x18
[19948952.788680] [<ffff0000080d89b4>] do_idle+0x10c/0x1a8
[19948952.793899] [<ffff0000080d8bb8>] cpu_startup_entry+0x20/0x28
[19948952.799812] [<ffff00000808e3a8>] secondary_start_kernel+0x100/0x110
[19948952.806330] [<00000000406b41c4>] 0x406b41c4
[19948952.810765] Task dump for CPU 2:
[19948952.814246] swapper/2       R  running task        0     0      1 0x00000000
[19948952.821545] Call trace:
[19948952.824249] [<ffff000008084d20>] __switch_to+0x90/0xa8
[19948952.829641] [<ffff000008968000>] page_wait_table+0x1280/0x1800
[19948952.835722] Task dump for CPU 3:
[19948952.839204] swapper/3       R  running task        0     0      1 0x00000000
[19948952.846503] Call trace:
[19948952.849207] [<ffff000008084d20>] __switch_to+0x90/0xa8
[19948952.854596] [<29ab2930a5313720>] 0x29ab2930a5313720
[19948952.859725] Task dump for CPU 0:
[19948952.863209] swapper/0       R  running task        0     0      0 0x00000000
[19948952.870509] Call trace:
[19948952.873214] [<ffff000008084d20>] __switch_to+0x90/0xa8
[19948952.878605] [<ffff000008968000>] page_wait_table+0x1280/0x1800
[19948952.884688] Task dump for CPU 1:
[19948952.888169] swapper/1       R  running task        0     0      1 0x00000002
[19948952.895468] Call trace:
[19948952.898173] [<ffff000008084d20>] __switch_to+0x90/0xa8
[19948952.903565] [<ffff000008968000>] page_wait_table+0x1280/0x1800
[19948952.909646] Task dump for CPU 2:
[19948952.913126] swapper/2       R  running task        0     0      1 0x00000000
[19948952.920426] Call trace:
[19948952.923131] [<ffff000008088098>] dump_backtrace+0x0/0x210
[19948952.928783] [<ffff0000080882fc>] show_stack+0x14/0x20
[19948952.934089] [<ffff0000080c8374>] sched_show_task+0x10c/0x170
[19948952.940001] [<ffff0000080c91e0>] dump_cpu_task+0x40/0x50
[19948952.945566] [<ffff0000080f44b4>] rcu_dump_cpu_stacks+0x94/0xe0
[19948952.951650] [<ffff0000080f3c1c>] rcu_check_callbacks+0x644/0x808
[19948952.957910] [<ffff0000080f7eec>] update_process_times+0x2c/0x58
[19948952.964081] [<ffff000008106e18>] tick_sched_handle.isra.5+0x30/0x50
[19948952.970599] [<ffff000008106e78>] tick_sched_timer+0x40/0x90
[19948952.976424] [<ffff0000080f8a60>] __hrtimer_run_queues+0xe8/0x160
[19948952.982681] [<ffff0000080f8cf0>] hrtimer_interrupt+0xa0/0x220
[19948952.988672] [<ffff000008578210>] arch_timer_handler_phys+0x30/0x40
[19948952.995104] [<ffff0000080e8490>] handle_percpu_devid_irq+0x78/0x130
[19948953.001624] [<ffff0000080e2eec>] generic_handle_irq+0x24/0x38
[19948953.007622] [<ffff0000080e3564>] __handle_domain_irq+0x5c/0xb8
[19948953.013705] [<ffff000008081528>] gic_handle_irq+0x58/0xb0
[19948953.019355] Exception stack(0xffff80003a8a3e20 to 0xffff80003a8a3f50)
[19948953.026046] 3e20: 0000000000000000 0000000000000000 0000000000000001 0000000000000000
[19948953.034124] 3e40: 0000000000000000 000080003365b000 0000000000000001 00000000000001c0
[19948953.042203] 3e60: ffff80003a8924e0 ffff80003a8a3ec0 0000000000000980 ffff800039e0a000
[19948953.050281] 3e80: 0000000000000000 0046df77739c426e 0000000000000000 0005d85dfcb6a33a
[19948953.058359] 3ea0: ffff0000081d13a8 0000ffff82d715c8 0000000000000000 ffff00000894e000
[19948953.066436] 3ec0: ffff000008968b30 ffff000008968000 ffff000008959078 0000000000000000
[19948953.074515] 3ee0: 0000000000000000 ffff80003a891b00 0000000000000000 0000000000000000
[19948953.082593] 3f00: 0000000000000000 ffff80003a8a3f50 ffff00000808485c ffff80003a8a3f50
[19948953.090672] 3f20: ffff000008084860 0000000000000145 0000000000000000 ffff0000080d8954
[19948953.098748] 3f40: ffffffffffffffff 7fffffffffffffff
[19948953.103879] [<ffff0000080827f4>] el1_irq+0xb4/0x140
[19948953.109011] [<ffff000008084860>] arch_cpu_idle+0x10/0x18
[19948953.114576] [<ffff0000080d89b4>] do_idle+0x10c/0x1a8
[19948953.119795] [<ffff0000080d8bbc>] cpu_startup_entry+0x24/0x28
[19948953.125707] [<ffff00000808e3a8>] secondary_start_kernel+0x100/0x110
[19948953.132224] [<00000000406b41c4>] 0x406b41c4
[19948953.136658] Task dump for CPU 3:
[19948953.140140] swapper/3       R  running task        0     0      1 0x00000000
[19948953.147438] Call trace:
[19948953.150143] [<ffff000008084d20>] __switch_to+0x90/0xa8
[19948953.155533] [<29ab2930a5313720>] 0x29ab2930a5313720

[CallMeFoxie]

Honestly no idea, I've got a cluster of 7 Pines + 1 spare and they can run fine for days :/ (2GB models)

[alaric]

Thanks for the reply,

Did a few changes to like enabled dhcp, time sync, apt-get update and installed a few applications and the problem seems to have gone away.
Might be a board issue so will ignore for now.

We are going to be targeting the new pineH64 (currently laying out a board for a project) so this board is just to help us in the interim.

Cheers,
Alaric

[ixoo]

Thanks for the reply,

Did a few changes to like enabled dhcp, time sync, apt-get update and installed a few applications and the problem seems to have gone away.
Might be a board issue so will ignore for now.

We are going to be targeting the new pineH64 (currently laying out a board for a project) so this board is just to help us in the interim.

Cheers,
Alaric

It could be linked to the power supply as well.
I had similar weird behaviors with PSU not delivering enough current.
Worth checking out if it reoccurs (typically happens under load).

[CallMeFoxie]

actually I power my 7 node pine cluster (+ a Gbit switch) off 5V 24A PSU via header pins rather than USB, may want to check the USB cable as well as the power brick itself if you're not using the header pins, good catch!

[dougunder]

Hi,

I'm trying to build with vagrant but uboot is failing to build


https://pastebin.com/9WnPbdMq

Any thought?

[CallMeFoxie]

Did you do `git submodule init`? There is a bunch of submodules.

Also I've not merged the Vagrant build way as I prefer using Docker myself so cannot support it (I've never used Vagrant).

[dougunder]

It built in fine in Debian unstable. I didn't dig into that vagrant enviroment.

Is there a partcilar way to dd the image and spl to a emmc module?
Something like dd if=u-boot-sunxi-image.spl of=/dev/sdX bs=X seek=X ?

Kind of new to u-boot.

[xalius]

For mainline u-boot it's usually

Code:

dd if=sunxi-spl.bin of=/dev/... bs=8k seek=1
dd if=u-boot.itb of=/dev/... bs=8k seek=5

[dougunder]

For mainline u-boot it's usually

Code:

dd if=sunxi-spl.bin of=/dev/... bs=8k seek=1
dd if=u-boot.itb of=/dev/... bs=8k seek=5

Careful with this!

My emmc is now non-functional.  Displaying as only 31m
Should have read Noobs section before F'in it up.



Know anyway to fix? dd'ing zeros didn't help.