07-31-2018, 03:09 PM
(This post was last modified: 08-04-2018, 11:40 PM by paradise.
Edit Reason: Added latest dmesg
)
Hi,
I made an image of an almost complete world of FreeBSD for the SoPine including all my patches.
Latest version with timecounter replacement
For clusterboards only!
** It's not and official FreeBSD build! It's from head ~3 weeks ago and I patched/hacked stuff together to make it work more stable for my use our clusterboards at work to avoid using Linux.
*** I'm just a FreeBSD user that is trying to install FreeBSD on about every device I can get my hands on.
-- It's a almost complete buildworld so there should be no problem with compatibility. It's almost a complete FreeBSD aarch64 base with modified drivers in the kernel and a modified DTB. (some already in the process of getting in the next FreeBSD version)
* What works (build-in modules and patched some stuff to work)
- Can boot from eMMC(*patched) and should boot from SD. (didn't test but already should work)
- Can boot with MFS (not in this image but you can change the boot.scr or push settings with dhcp)
- Can boot from PXE(*patched loader.efi to not crash if there is no disk at all -- I think base also already fixed this bug)
- CPU Frequency settings (1248Mhz, 1200Mhz, 1008Mhz, 816Mhz (DEFAULT), 528Mhz) (Fixed in DTB)
- Thermal sensor (Fixed in DTB and added weird factor clock) -- Getting pached in base soon
- DMA Controller (DTB and patched some kernel files)
- SRAM Controller for ethernet only (DTB Mappings)
- SD, eMMC both work but may spit out messages at boot only depending on what you have inserted. (I use PXE+MFS+NFS so less prio)
- Patched ethernet if_awg and rgephy and now only does 1000baseT/full because on the clusterboard that's all we have and we don't need al the extra code anyway. :-)
v1.1 patches
* HS Timer is now usable as kernel timecounter (not active by default)
You can configure countdown with debug dev.a64_hstimer.0.magic-clock (if your osc is out of wack)
Still working on improving it, it now generates 1k interrupts next version I will try and cut it down by a lot.
* Fixed a time jump issue / workaround for main timer hardware bug when it rolls-over not all bits end up as expected.
This workaround also fixes threads hanging randomly on _nanosleep()
If you notice time jumps on a node: enable this with: sysctl kern.timecounter.hardware="A64 HS Timer"
-- also you may want to tweak this for time keeping: sysctl dev.a64_hstimer.0.magic-clock=100004
* Solved the ethernet link dropping issue
* Added gdb from ports. (needed to troubleshoot the thread hanging issue)
* Removed some debug messages I had put in the kernel to find some issues.
* Enabled Invariants, Witness and deadlock resolver in the kernel for troubleshooting. (worthless if you have clock issues but was handy to notice how bad locking in filesystem currently is and made me go to a much simpler PXE boot setup using a more stable MFS as root)
* Completely removed USB support. It's not working anyway.
* Doesn't work
- No framebuffer (can't use/test it on clusterboard) -- It's even removed from the devicetree so don't even try soldering a HDMI connector to your clusterboard! :-)
- USB doesn't seem to be working but I doubt the connection didn't get it working in Linux either. (disabled in dtb and kernel)
- No MALI support what so ever.. regulators for MALI and other stuff are off.
- There is still lots of stuff in the kernel we don't use on the sopine cluster I'd like to remove making the kernel a bit smaller.
* Issues
- Ethernet is fast but not yet 100% stable.. there are a few link drops for a millisecond or so **FIXED in 1.1
- Be careful with mounting stuff on top of other stuff, nullfs, tmpfs and NFS have some weird locking issue (i think only on aarch64?! / FreeBSD 12) a.t.m. However witness will freak out at boot on it a.t.m. which is a bit better then unexpected hangs/deadlocks while in production. :-)
* Image
You can use stuff like pkg install and portsnap but you need to remove the /var (and maybe) /tmp ramdisks first.
-- ports tested: I installed glusterfs from ports with somewhat same build as this so it should work!
-- pkg install: I installed nano from pkg install nano
I have it running on 7 nodes myself using PXE/MFS and NFS and it's getting more stable with every patch. :-)
Next version (v1.2) I hope to also include configs and stuff I use for DHCP/PXE booting the modules so you could use the first node as master sharing eMMS with the 6 other nodes via NFS.. Need to compile stuff like dhcpd first for ARM.
* Login
Login via SSH: sopine/sopine (sopine is in wheel)
Root has no password
https://pastebin.com/fTBxnRBS <- dmesg (little dated)
https://drive.google.com/open?id=1r_J36Z...teieYH08PF <- Image V1.1
I made an image of an almost complete world of FreeBSD for the SoPine including all my patches.
Latest version with timecounter replacement
Code:
KDB: debugger backends: ddb
KDB: current backend: ddb
Type Physical Virtual #Pages Attr
ConventionalMemory 000040000000 40000000 00008000 WB
RuntimeServicesData 000048000000 48000000 00000008 WB RUNTIME
ConventionalMemory 000048009000 40000000 00068e8a WB
LoaderData 0000b0e93000 b0e93000 00000001 WB
LoaderData 0000b0e94000 b0e94000 00004000 WB
LoaderData 0000b4e94000 b4e94000 00004000 WB
LoaderCode 0000b8e94000 b8e94000 00000074 WB
RuntimeServicesData 0000b8f08000 b8f08000 00000001 WB RUNTIME
Reserved 0000b8f09000 b8f09000 00000001 WB
Reserved 0000b8f0a000 b8f0a000 00000001 WB
Reserved 0000b8f0b000 b8f0b000 00000001 WB
Reserved 0000b8f0c000 b8f0c000 00000001 WB
Reserved 0000b8f0d000 b8f0d000 00000001 WB
Reserved 0000b8f0e000 b8f0e000 00000001 WB
Reserved 0000b8f0f000 b8f0f000 00000001 WB
Reserved 0000b8f10000 b8f10000 00000001 WB
Reserved 0000b8f11000 b8f11000 00000001 WB
Reserved 0000b8f12000 b8f12000 00000001 WB
Reserved 0000b8f13000 b8f13000 00000001 WB
Reserved 0000b8f14000 b8f14000 00000001 WB
Reserved 0000b8f15000 b8f15000 00000001 WB
Reserved 0000b8f16000 b8f16000 00000001 WB
Reserved 0000b8f17000 b8f17000 00000001 WB
Reserved 0000b8f18000 b8f18000 00000001 WB
Reserved 0000b8f19000 b8f19000 00000001 WB
Reserved 0000b8f1a000 b8f1a000 00000001 WB
Reserved 0000b8f1b000 b8f1b000 00000001 WB
Reserved 0000b8f1c000 b8f1c000 00000001 WB
Reserved 0000b8f1d000 b8f1d000 00000001 WB
Reserved 0000b8f1e000 b8f1e000 00000001 WB
Reserved 0000b8f1f000 b8f1f000 00000001 WB
Reserved 0000b8f20000 b8f20000 00000001 WB
Reserved 0000b8f21000 b8f21000 00000001 WB
Reserved 0000b8f22000 b8f22000 00000001 WB
Reserved 0000b8f23000 b8f23000 00000001 WB
Reserved 0000b8f24000 b8f24000 00000001 WB
Reserved 0000b8f25000 b8f25000 00000001 WB
Reserved 0000b8f26000 b8f26000 00000001 WB
Reserved 0000b8f27000 b8f27000 00000001 WB
Reserved 0000b8f28000 b8f28000 00000001 WB
Reserved 0000b8f29000 b8f29000 00000001 WB
Reserved 0000b8f2a000 b8f2a000 00000001 WB
Reserved 0000b8f2b000 b8f2b000 00000001 WB
Reserved 0000b8f2c000 b8f2c000 00000001 WB
LoaderData 0000b8f2d000 b8f2d000 0000508e WB
RuntimeServicesCode 0000bdfbb000 bdfbb000 00000001 WB RUNTIME
LoaderData 0000bdfbc000 b8f2d000 00002044 WB
Physical memory chunk(s):
0x40000000 - 0x48007fff, 128 MB ( 32776 pages)
0x48009000 - 0xb8f08fff, 1807 MB ( 462592 pages)
0xb8f2d000 - 0xbdfbafff, 80 MB ( 20622 pages)
0xbdfbc000 - 0xbfffffff, 32 MB ( 8260 pages)
Excluded memory regions:
0x48000000 - 0x48007fff, 0 MB ( 8 pages) NoAlloc
0xb1000000 - 0xb25bcfff, 21 MB ( 5565 pages) NoAlloc
0xb8f08000 - 0xb8f2cfff, 0 MB ( 37 pages) NoAlloc
0xbdfbb000 - 0xbdfbbfff, 0 MB ( 1 pages) NoAlloc
Found 4 CPUs in the device tree
Copyright (c) 1992-2018 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 12.0-CURRENT #173 4347b60bdbb(master)-dirty: Sat Aug 4 15:43:58 CEST 2018
FreeBSD clang version 6.0.1 (tags/RELEASE_601/final 335540) (based on LLVM 6.0.1)
WARNING: WITNESS option enabled, expect reduced performance.
Preloaded elf kernel "/boot/kernel/kernel" at 0xffff000001397000.
Preloaded boot_entropy_cache "/boot/entropy" at 0xffff0000013a02b8.
Preloaded mfs_root "/boot/pgcv1.uzip" at 0xffff0000013a0310.
Starting CPU 1 (1)
Starting CPU 2 (2)
Starting CPU 3 (3)
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
random: read 3840 bytes from preloaded cache
random: unblocking device.
arc4random: read 32 bytes from preloaded cache
VIMAGE (virtualized network stack) enabled
ULE: setup cpu 0
ULE: setup cpu 1
ULE: setup cpu 2
ULE: setup cpu 3
random: entropy device external interface
MAP 48000000 mode 2 pages 8
MAP b8f08000 mode 2 pages 1
MAP bdfbb000 mode 2 pages 1
mem: <memory>
null: <full device, null device, zero device>
openfirm: <Open Firmware control device>
nfslock: pseudo-device
crypto: <crypto core>
random: harvesting attach, 8 bytes (4 bits) from nexus0
ofwbus0: <Open Firmware Device Tree>
clk_fixed0: <Fixed clock> on ofwbus0
random: harvesting attach, 8 bytes (4 bits) from clk_fixed0
clk_fixed1: <Fixed clock> on ofwbus0
random: harvesting attach, 8 bytes (4 bits) from clk_fixed1
clk_fixed2: <Fixed clock> on ofwbus0
random: harvesting attach, 8 bytes (4 bits) from clk_fixed2
simplebus0: <Flattened device tree simple bus> on ofwbus0
ccu_a64ng0: <Allwinner A64 Clock Control Unit NG> mem 0x1c20000-0x1c203ff on simplebus0
ccu_a64ng0: Setting pll_periph0 as parent for ahb1
ccu_a64ng0: Setting pll_periph0 as parent for ahb2
ccu_a64ng0: Setting pll_ddr0 as parent for dram
Clock: pll_cpux, parent: osc24M(0), freq: 816000000
Clock: pll_audio, parent: osc24M(0), freq: 24571428
Clock: pll_periph0_2x, parent: osc24M(0), freq: 600000000
Clock: pll_periph1_2x, parent: osc24M(0), freq: 600000000
Clock: pll_ddr0, parent: osc24M(0), freq: 408000000
Clock: pll_ddr1, parent: osc24M(0), freq: 1104000000
Clock: pll_video0, parent: osc24M(0), freq: 30303
Clock: pll_video1, parent: osc24M(0), freq: 30303
Clock: pll_ve, parent: osc24M(0), freq: 30303
Clock: pll_gpu, parent: osc24M(0), freq: 30303
Clock: pll_de, parent: osc24M(0), freq: 30303
Clock: pll_hsic, parent: osc24M(0), freq: 1200000
Clock: apb2, parent: osc24M(1), freq: 24000000
Clock: nand, parent: osc24M(0), freq: 12000000
Clock: mmc0, parent: osc24M(0), freq: 400000
Clock: mmc1, parent: osc24M(0), freq: 24000000
Clock: mmc2, parent: osc24M(0), freq: 400000
Clock: ts, parent: osc24M(0), freq: 24000000
Clock: ce, parent: osc24M(0), freq: 24000000
Clock: spi0, parent: osc24M(0), freq: 24000000
Clock: spi1, parent: osc24M(0), freq: 24000000
Clock: spdif, parent: pll_audio(0), freq: 24571428
Clock: dram, parent: pll_ddr0(0), freq: 408000000
Clock: de, parent: pll_periph0_2x(0), freq: 600000000
Clock: deinterlace, parent: pll_periph0(0), freq: 300000000
Clock: csi-sclk, parent: pll_periph0(0), freq: 300000000
Clock: csi-mclk, parent: osc24M(0), freq: 24000000
Clock: ve, parent: pll_ve(0), freq: 30303
Clock: hdmi, parent: pll_video0(0), freq: 30303
Clock: mbus, parent: pll_periph0_2x(1), freq: 200000000
Clock: gpu, parent: pll_gpu(0), freq: 30303
Clock: ths, parent: osc24M(0), freq: 24000000
Clock: ahb1, parent: pll_periph0(3), freq: 300000000
Clock: ahb2, parent: pll_periph0(1), freq: 150000000
Clock: cpux, parent: pll_cpux(2), freq: 816000000
Clock: i2s0mux, parent: pll_audio-8x(0), freq: 196571424
Clock: i2s1mux, parent: pll_audio-8x(0), freq: 196571424
Clock: i2s2mux, parent: pll_audio-8x(0), freq: 196571424
Clock: axi, parent: cpux(0), freq: 204000000
Clock: apb1, parent: ahb1(0), freq: 75000000
Clock: apb, parent: cpux(0), freq: 272000000
Clock: osc12M, parent: osc24M(0), freq: 12000000
Clock: pll_periph0, parent: pll_periph0_2x(0), freq: 300000000
Clock: pll_periph1, parent: pll_periph1_2x(0), freq: 300000000
Clock: pll_audio-2x, parent: pll_audio(0), freq: 49142856
Clock: pll_audio-4x, parent: pll_audio(0), freq: 98285712
Clock: pll_audio-8x, parent: pll_audio(0), freq: 196571424
Clock: bus-mipi-dsi, parent: ahb1(0), freq: 300000000
Clock: bus-ce, parent: ahb1(0), freq: 300000000
Clock: bus-dma, parent: ahb1(0), freq: 300000000
Clock: bus-mmc0, parent: ahb1(0), freq: 300000000
Clock: bus-mmc1, parent: ahb1(0), freq: 300000000
Clock: bus-mmc2, parent: ahb1(0), freq: 300000000
Clock: bus-nand, parent: ahb1(0), freq: 300000000
Clock: bus-dram, parent: ahb1(0), freq: 300000000
Clock: bus-emac, parent: ahb2(0), freq: 150000000
Clock: bus-ts, parent: ahb1(0), freq: 300000000
Clock: bus-hstimer, parent: ahb1(0), freq: 300000000
Clock: bus-spi0, parent: ahb1(0), freq: 300000000
Clock: bus-spi1, parent: ahb1(0), freq: 300000000
Clock: bus-otg, parent: ahb1(0), freq: 300000000
Clock: bus-ehci0, parent: ahb1(0), freq: 300000000
Clock: bus-ehci1, parent: ahb2(0), freq: 150000000
Clock: bus-ohci0, parent: ahb1(0), freq: 300000000
Clock: bus-ohci1, parent: ahb2(0), freq: 150000000
Clock: bus-ve, parent: ahb1(0), freq: 300000000
Clock: bus-tcon0, parent: ahb1(0), freq: 300000000
Clock: bus-tcon1, parent: ahb1(0), freq: 300000000
Clock: bus-deinterlace, parent: ahb1(0), freq: 300000000
Clock: bus-csi, parent: ahb1(0), freq: 300000000
Clock: bus-hdmi, parent: ahb1(0), freq: 300000000
Clock: bus-de, parent: ahb1(0), freq: 300000000
Clock: bus-gpu, parent: ahb1(0), freq: 300000000
Clock: bus-msgbox, parent: ahb1(0), freq: 300000000
Clock: bus-spinlock, parent: ahb1(0), freq: 300000000
Clock: bus-codec, parent: apb1(0), freq: 75000000
Clock: bus-spdif, parent: apb1(0), freq: 75000000
Clock: bus-pio, parent: apb1(0), freq: 75000000
Clock: bus-ths, parent: apb1(0), freq: 75000000
Clock: bus-i2s0, parent: apb1(0), freq: 75000000
Clock: bus-i2s1, parent: apb1(0), freq: 75000000
Clock: bus-i2s2, parent: apb1(0), freq: 75000000
Clock: bus-i2c0, parent: apb2(0), freq: 24000000
Clock: bus-i2c1, parent: apb2(0), freq: 24000000
Clock: bus-i2c2, parent: apb2(0), freq: 24000000
Clock: bus-src, parent: apb2(0), freq: 24000000
Clock: bus-uart0, parent: apb2(0), freq: 24000000
Clock: bus-uart1, parent: apb2(0), freq: 24000000
Clock: bus-uart2, parent: apb2(0), freq: 24000000
Clock: bus-uart3, parent: apb2(0), freq: 24000000
Clock: bus-uart4, parent: apb2(0), freq: 24000000
Clock: bus-dbg, parent: ahb1(0), freq: 300000000
Clock: usb-phy0, parent: osc24M(0), freq: 24000000
Clock: usb-phy1, parent: osc24M(0), freq: 24000000
Clock: usb-hsic, parent: pll_hsic(0), freq: 1200000
Clock: usb-hsic-12M, parent: osc12M(0), freq: 12000000
Clock: usb-ohci0, parent: osc12M(0), freq: 12000000
Clock: usb-ohci1, parent: usb-ohci0(0), freq: 12000000
Clock: dram-ve, parent: dram(0), freq: 408000000
Clock: dram-csi, parent: dram(0), freq: 408000000
Clock: dram-deinterlace, parent: dram(0), freq: 408000000
Clock: dram-ts, parent: dram(0), freq: 408000000
Clock: csi-misc, parent: osc24M(0), freq: 24000000
Clock: ac-dig, parent: pll_audio(0), freq: 24571428
Clock: ac-dig-4x, parent: pll_audio-4x(0), freq: 98285712
Clock: avs, parent: osc24M(0), freq: 24000000
Clock: hdmi-ddc, parent: osc24M(0), freq: 24000000
random: harvesting attach, 8 bytes (4 bits) from ccu_a64ng0
random: harvesting attach, 8 bytes (4 bits) from simplebus0
regfix0: <Fixed Regulator> on ofwbus0
random: harvesting attach, 8 bytes (4 bits) from regfix0
random: harvesting attach, 8 bytes (4 bits) from ofwbus0
ccu_sun8i_r0: <Allwinner SUN8I_R Clock Control Unit NG> mem 0x1f01400-0x1f014ff on simplebus0
Clock: ar100, parent: osc32k(0), freq: 32768
Clock: apb0, parent: ahb0(0), freq: 32768
Clock: ahb0, parent: ar100(0), freq: 32768
Clock: ir, parent: osc32k(0), freq: 32768
Clock: apb0-pio, parent: apb0(0), freq: 32768
Clock: apb0-ir, parent: apb0(0), freq: 32768
Clock: apb0-timer, parent: apb0(0), freq: 32768
Clock: apb0-rsb, parent: apb0(0), freq: 32768
Clock: apb0-uart, parent: apb0(0), freq: 32768
Clock: apb0-i2c, parent: apb0(0), freq: 32768
Clock: apb0-twd, parent: apb0(0), freq: 32768
random: harvesting attach, 8 bytes (4 bits) from ccu_sun8i_r0
psci0: <ARM Power State Co-ordination Interface Driver> on ofwbus0
psci0: PSCI version 0.2 compatible
random: harvesting attach, 8 bytes (4 bits) from psci0
iichb0: <Allwinner RSB> mem 0x1f03400-0x1f037ff irq 35 on simplebus0
iicbus0: <OFW I2C bus> on iichb0
random: harvesting attach, 8 bytes (4 bits) from iicbus0
random: harvesting attach, 8 bytes (4 bits) from iichb0
gic0: <ARM Generic Interrupt Controller> mem 0x1c81000-0x1c81fff,0x1c82000-0x1c83fff,0x1c84000-0x1c85fff,0x1c86000-0x1c87fff irq 30 on simplebus0
gic0: pn 0x2, arch 0x2, rev 0x1, implementer 0x43b irqs 224
random: harvesting attach, 8 bytes (4 bits) from gic0
gpio0: <Allwinner GPIO/Pinmux controller> mem 0x1c20800-0x1c20bff irq 13,14,15 on simplebus0
gpiobus0: <OFW GPIO bus> on gpio0
random: harvesting attach, 8 bytes (4 bits) from gpiobus0
Processing 1 pin-config node(s) in pinctrl-0 for serial@1c28000
Processing 1 pin-config node(s) in pinctrl-0 for ethernet@1c30000
Processing 1 pin-config node(s) in pinctrl-0 for rsb@1f03400
Processing 1 pin-config node(s) in pinctrl-0 for serial@1c28000
Processing 1 pin-config node(s) in pinctrl-0 for ethernet@1c30000
Processing 1 pin-config node(s) in pinctrl-0 for rsb@1f03400
random: harvesting attach, 8 bytes (4 bits) from gpio0
aw_nmi0: <Allwinner NMI Controller> mem 0x1f00c00-0x1f00fff irq 33 on simplebus0
random: harvesting attach, 8 bytes (4 bits) from aw_nmi0
gpio1: <Allwinner GPIO/Pinmux controller> mem 0x1f02c00-0x1f02fff irq 34 on simplebus0
gpiobus1: <OFW GPIO bus> on gpio1
random: harvesting attach, 8 bytes (4 bits) from gpiobus1
Processing 1 pin-config node(s) in pinctrl-0 for serial@1c28000
Processing 1 pin-config node(s) in pinctrl-0 for ethernet@1c30000
Processing 1 pin-config node(s) in pinctrl-0 for rsb@1f03400
Processing 1 pin-config node(s) in pinctrl-0 for serial@1c28000
Processing 1 pin-config node(s) in pinctrl-0 for ethernet@1c30000
Processing 1 pin-config node(s) in pinctrl-0 for rsb@1f03400
random: harvesting attach, 8 bytes (4 bits) from gpio1
axp8xx_pmu0: <X-Powers AXP803 Power Management Unit> at addr 0x746 irq 48 on iicbus0
axp8xx_pmu0: chip ID 0x51
gpiobus2: <OFW GPIO bus> on axp8xx_pmu0
random: harvesting attach, 8 bytes (4 bits) from gpiobus2
random: harvesting attach, 8 bytes (4 bits) from axp8xx_pmu0
generic_timer0: <ARMv8 Generic Timer> irq 0,1,2,3 on ofwbus0
Timecounter "ARM MPCore Timecounter" frequency 24000000 Hz quality 1000
Event timer "ARM MPCore Eventtimer" frequency 24000000 Hz quality 1000
random: harvesting attach, 8 bytes (4 bits) from generic_timer0
rtc0: <Allwinner RTC> mem 0x1f00000-0x1f00220 irq 31,32 on simplebus0
rtc0: Using external oscillator
rtc0: VDD Regulator state 4
rtc0: registered as a time-of-day clock, resolution 1.000000s
random: harvesting attach, 8 bytes (4 bits) from rtc0
a64_hstimer0: <Allwinner A64HS timer> mem 0x1c60000-0x1c60023 irq 38 on simplebus0
Timecounter "A64 HS Timer" frequency 1000 Hz quality 999
a64_hstimer0: clock: hz=1000 stathz = 0
a64_hstimer0: event timer clock frequency 150000000
random: harvesting attach, 8 bytes (4 bits) from a64_hstimer0
efirtc0: cannot read EFI realtime clock
cpulist0: <Open Firmware CPU Group> on ofwbus0
cpu0: <Open Firmware CPU> on cpulist0
arm64_cpu0: register <0>
random: harvesting attach, 8 bytes (4 bits) from arm64_cpu0
cpufreq_dt0: <Generic cpufreq driver> on cpu0
cpufreq_dt0: 1248.000 MHz, 1300000 uV
cpufreq_dt0: 1200.000 MHz, 1260000 uV
cpufreq_dt0: 1008.000 MHz, 1200000 uV
cpufreq_dt0: 816.000 MHz, 1200000 uV
cpufreq_dt0: 528.000 MHz, 1040000 uV
random: harvesting attach, 8 bytes (4 bits) from cpufreq0
random: harvesting attach, 8 bytes (4 bits) from cpufreq_dt0
random: harvesting attach, 8 bytes (4 bits) from cpu0
cpu1: <Open Firmware CPU> on cpulist0
arm64_cpu1: register <1>
random: harvesting attach, 8 bytes (4 bits) from arm64_cpu1
random: harvesting attach, 8 bytes (4 bits) from cpu1
cpu2: <Open Firmware CPU> on cpulist0
arm64_cpu2: register <2>
random: harvesting attach, 8 bytes (4 bits) from arm64_cpu2
random: harvesting attach, 8 bytes (4 bits) from cpu2
cpu3: <Open Firmware CPU> on cpulist0
arm64_cpu3: register <3>
random: harvesting attach, 8 bytes (4 bits) from arm64_cpu3
random: harvesting attach, 8 bytes (4 bits) from cpu3
random: harvesting attach, 8 bytes (4 bits) from cpulist0
ofwbus0: <sound_spdif> compat simple-audio-card (no driver attached)
ofwbus0: <spdif-out> compat linux,spdif-dit (no driver attached)
syscon_generic0: <syscon> mem 0x1c00000-0x1c00033 on simplebus0
random: harvesting attach, 8 bytes (4 bits) from syscon_generic0
a31dmac0: <Allwinner DMA controller> mem 0x1c02000-0x1c02fff irq 4 on simplebus0
random: harvesting attach, 8 bytes (4 bits) from a31dmac0
simplebus0: <mmc@1c0f000> mem 0x1c0f000-0x1c0ffff irq 5 disabled compat allwinner,sun50i-a64-mmc (no driver attached)
simplebus0: <mmc@1c10000> mem 0x1c10000-0x1c10fff irq 6 disabled compat allwinner,sun50i-a64-mmc (no driver attached)
simplebus0: <mmc@1c11000> mem 0x1c11000-0x1c11fff irq 7 disabled compat allwinner,sun50i-a64-emmc (no driver attached)
simplebus0: <usb@1c19000> mem 0x1c19000-0x1c193ff irq 8 disabled compat allwinner,sun8i-a33-musb (no driver attached)
simplebus0: <phy@1c19400> mem 0x1c19400-0x1c19413,0x1c1a800-0x1c1a803,0x1c1b800-0x1c1b803 disabled compat allwinner,sun50i-a64-usb-phy (no driver attached)
simplebus0: <usb@1c1a000> mem 0x1c1a000-0x1c1a0ff irq 9 disabled compat allwinner,sun50i-a64-ehci (no driver attached)
simplebus0: <usb@1c1a400> mem 0x1c1a400-0x1c1a4ff irq 10 disabled compat allwinner,sun50i-a64-ohci (no driver attached)
simplebus0: <usb@1c1b000> mem 0x1c1b000-0x1c1b0ff irq 11 disabled compat allwinner,sun50i-a64-ehci (no driver attached)
simplebus0: <usb@1c1b400> mem 0x1c1b400-0x1c1b4ff irq 12 disabled compat allwinner,sun50i-a64-ohci (no driver attached)
gpioc0: <GPIO controller> on gpio0
random: harvesting attach, 8 bytes (4 bits) from gpioc0
simplebus0: <spdif@1c21000> mem 0x1c21000-0x1c213ff irq 16 disabled compat allwinner,sun50i-a64-spdif (no driver attached)
simplebus0: <i2s@1c22000> mem 0x1c22000-0x1c223ff irq 17 disabled compat allwinner,sun50i-a64-i2s (no driver attached)
simplebus0: <i2s@1c22400> mem 0x1c22400-0x1c227ff irq 18 disabled compat allwinner,sun50i-a64-i2s (no driver attached)
uart0: <16750 or compatible> mem 0x1c28000-0x1c283ff irq 19 on simplebus0
uart0: console (115384,n,8,1)
uart0: fast interrupt
uart0: PPS capture mode: DCD
random: harvesting attach, 8 bytes (4 bits) from uart0
simplebus0: <serial@1c28400> mem 0x1c28400-0x1c287ff irq 20 disabled compat snps,dw-apb-uart (no driver attached)
simplebus0: <serial@1c28800> mem 0x1c28800-0x1c28bff irq 21 disabled compat snps,dw-apb-uart (no driver attached)
simplebus0: <serial@1c28c00> mem 0x1c28c00-0x1c28fff irq 22 disabled compat snps,dw-apb-uart (no driver attached)
simplebus0: <serial@1c29000> mem 0x1c29000-0x1c293ff irq 23 disabled compat snps,dw-apb-uart (no driver attached)
simplebus0: <i2c@1c2ac00> mem 0x1c2ac00-0x1c2afff irq 24 disabled compat allwinner,sun6i-a31-i2c (no driver attached)
simplebus0: <i2c@1c2b000> mem 0x1c2b000-0x1c2b3ff irq 25 disabled compat allwinner,sun6i-a31-i2c (no driver attached)
simplebus0: <i2c@1c2b400> mem 0x1c2b400-0x1c2b7ff irq 26 disabled compat allwinner,sun6i-a31-i2c (no driver attached)
simplebus0: <spi@1c68000> mem 0x1c68000-0x1c68fff irq 27 disabled compat allwinner,sun8i-h3-spi (no driver attached)
simplebus0: <spi@1c69000> mem 0x1c69000-0x1c69fff irq 28 disabled compat allwinner,sun8i-h3-spi (no driver attached)
awg0: <Allwinner Gigabit Ethernet> mem 0x1c30000-0x1c3ffff irq 29 on simplebus0
simplebus0: no default resources for rid = 1, type = 3
awg0: PHY type: rgmii, conf mode: reg
awg0: EMAC clock: 0x00000806
axp8xx_pmu0: Enable vcc-phy (dc1sw)
awg0: AHB frequency 150000000 Hz, MDC div: 0x2
reset
miibus0: <MII bus> on awg0
rgephy0: <RTL8169S/8110S/8211 1000BASE-T media interface> PHY 0 on miibus0
rgephy0: OUI 0x00e04c, model 0x0011, rev. 5
rgephy0: none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flowrandom: harvesting attach, 8 bytes (4 bits) from rgephy0
rgephy1: <RTL8169S/8110S/8211 1000BASE-T media interface> PHY 1 on miibus0
rgephy1: OUI 0x00e04c, model 0x0011, rev. 5
rgephy1: none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flowrandom: harvesting attach, 8 bytes (4 bits) from rgephy1
random: harvesting attach, 8 bytes (4 bits) from miibus0
awg0: bpf attached
awg0: Ethernet address: 02:ba:0b:87:36:64
random: harvesting attach, 8 bytes (4 bits) from awg0
gpioc1: <GPIO controller> on gpio1
random: harvesting attach, 8 bytes (4 bits) from gpioc1
gpioc2: <GPIO controller> on axp8xx_pmu0
random: harvesting attach, 8 bytes (4 bits) from gpioc2
iic0: <I2C generic I/O> on iicbus0
random: harvesting attach, 8 bytes (4 bits) from iic0
aw_wdog0: <Allwinner A31 Watchdog> mem 0x1c20ca0-0x1c20cbf irq 36 on simplebus0
random: harvesting attach, 8 bytes (4 bits) from aw_wdog0
simplebus0: <pwm@1c21400> mem 0x1c21400-0x1c21407 irq 37 disabled compat allwinner,sun50i-a64-pwm (no driver attached)
simplebus0: <dai@1c22c00> mem 0x1c22c00-0x1c22dff irq 39 disabled compat allwinner,sun50i-a64-acodec-i2s (no driver attached)
simplebus0: <codec@1c22e00> mem 0x1c22e00-0x1c233ff irq 40 disabled compat allwinner,sun50i-a64-codec (no driver attached)
aw_thermal0: <Allwinner Thermal Sensor Controller> mem 0x1c25000-0x1c253ff irq 41 on simplebus0
aw_thermal0: #0: cur 253C alarm 85C hyst 58C shut 106C
aw_thermal0: #1: cur 253C alarm 85C hyst 58C shut 106C
aw_thermal0: #2: cur 253C alarm 85C hyst 58C shut 106C
random: harvesting attach, 8 bytes (4 bits) from aw_thermal0
simplebus0: <codec-analog@1f015c0> mem 0x1f015c0-0x1f015c3 disabled compat allwinner,sun50i-a64-codec-analog (no driver attached)
simplebus0: <gpu@1c40000> mem 0-0x1c3ffff,0-0xffff irq 42,43,44,45,46,47 disabled type gpu_mali400_0 compat arm,mali-400 (no driver attached)
ofwbus0: <sound> disabled compat simple-audio-card (no driver attached)
cryptosoft0: <software crypto>
crypto: assign cryptosoft0 driver id 0, flags 0x6000000
crypto: cryptosoft0 registers alg 1 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 2 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 3 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 4 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 5 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 16 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 6 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 7 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 32 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 18 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 19 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 20 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 8 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 15 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 9 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 10 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 13 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 14 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 34 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 35 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 36 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 37 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 11 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 22 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 23 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 25 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 24 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 26 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 27 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 28 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 21 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 17 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 29 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 30 flags 0 maxoplen 0
crypto: cryptosoft0 registers alg 31 flags 0 maxoplen 0
random: harvesting attach, 8 bytes (4 bits) from cryptosoft0
Found SMCCC version 1.0
Device configuration finished.
procfs registered
Timecounters tick every 1.000 msec
lo0: bpf attached
vlan: initialized, using hash tables with chaining
arc4random: read 32 bytes from preloaded cache
arc4random: read 32 bytes from preloaded cache
arc4random: read 32 bytes from preloaded cache
tcp_init: net.inet.tcp.tcbhashsize auto tuned to 16384
IPsec: Initialized Security Association Processing.
md0: Preloaded image </boot/pgcv1.uzip> 3024384 bytes at 0xffff0000010ac848
Release APs...done
CPU 0: ARM Cortex-A53 r0p4Trying to mount root from ufs:/dev/ufs/ROOTFS []...
affinity: 0
Instruction Set Attributes 0 = <g_uzip_lzma_decompress: ibp=0xfffffd00006c9734, obp=0xffff00005c144000, in_pos=0, out_pos=0, in_size=204, out_size=8192
AES+PMULLg_uzip_lzma_decompress: ibp=0xfffffd000074f934, obp=0xffff00005c144000, in_pos=0, out_pos=0, in_size=204, out_size=8192
,SHA1g_uzip_lzma_decompress: ibp=0xfffffd000074f734, obp=0xffff00005c144000, in_pos=0, out_pos=0, in_size=204, out_size=8192
,SHA2,CRC32>
g_uzip_lzma_decompress: ibp=0xfffffd000074f534, obp=0xffff00005c144000, in_pos=0, out_pos=0, in_size=204, out_size=8192
Instruction Set Attributes 1 = <g_uzip_lzma_decompress: ibp=0xfffffd000074f334, obp=0xffff00005c144000, in_pos=0, out_pos=0, in_size=204, out_size=8192
>
Processor Features 0 = <g_uzip_lzma_decompress: ibp=0xfffffd000074f134, obp=0xffff00005c144000, in_pos=0, out_pos=0, in_size=204, out_size=8192
AdvSIMD,Float,EL3 32,EL2 32,EL1 32g_uzip_lzma_decompress: ibp=0xfffffd000074e734, obp=0xffff00005c144000, in_pos=0, out_pos=0, in_size=204, out_size=8192
,EL0 32g_uzip_lzma_decompress: ibp=0xfffffd000074e534, obp=0xffff00005c144000, in_pos=0, out_pos=0, in_size=204, out_size=8192
>
g_uzip_lzma_decompress: ibp=0xfffffd000074e334, obp=0xffff00005c144000, in_pos=0, out_pos=0, in_size=204, out_size=8192
Processor Features 1 = <0>
g_uzip_lzma_decompress: ibp=0xfffffd000074e134, obp=0xffff00005c144000, in_pos=0, out_pos=0, in_size=204, out_size=8192
Memory Model Features 0 = <g_uzip_lzma_decompress: ibp=0xfffffd00006c9d34, obp=0xffff00005c144000, in_pos=0, out_pos=0, in_size=204, out_size=8192
4k Granuleg_uzip_lzma_decompress: ibp=0xfffffd00006c9b34, obp=0xffff00005c144000, in_pos=0, out_pos=0, in_size=204, out_size=8192
,64k Granuleg_uzip_lzma_decompress: ibp=0xfffffd00006c9934, obp=0xffff00005c144000, in_pos=0, out_pos=0, in_size=204, out_size=8192
,MixedEndiang_uzip_lzma_decompress: ibp=0xfffffd0000798b34, obp=0xffff00005c144000, in_pos=0, out_pos=0, in_size=204, out_size=8192
,S/NS Memg_uzip_lzma_decompress: ibp=0xfffffd0000798934, obp=0xffff00005c144000, in_pos=0, out_pos=0, in_size=204, out_size=8192
,16bit ASIDg_uzip_lzma_decompress: ibp=0xfffffd0000798734, obp=0xffff00005c144000, in_pos=0, out_pos=0, in_size=204, out_size=8192
,1TB PA>
Memory Model Features 1 = <>
Memory Model Features 2 = <32b CCIDX,48b VA>
Debug Features 0 = <2 CTX Breakpoints,4 Watchpoints,6 Breakpoints,PMUv3,Debug v8>
Debug Features 1 = <0>
rtc0: Auxiliary Features 0 = <0>
providing initial system time
Auxiliary Features 1 = <0>
start_init: trying /sbin/init
CPU 1: ARM Cortex-A53 r0p4 affinity: 1
CPU 2: ARM Cortex-A53 r0p4 affinity: 2
CPU 3: ARM Cortex-A53 r0p4 affinity: 3
WARNING: WITNESS option enabled, expect reduced performance.
regulator: shutting down vcc1v8
regulator: shutting down dcdc3
axp8xx_pmu0: Disable dcdc3 (dcdc3)
regulator: shutting down dcdc4
axp8xx_pmu0: Disable dcdc4 (dcdc4)
regulator: shutting down vcc-hdmi
axp8xx_pmu0: Disable vcc-hdmi (dldo1)
regulator: shutting down vcc-mipi
axp8xx_pmu0: Disable vcc-mipi (dldo2)
regulator: shutting down avdd-csi
axp8xx_pmu0: Disable avdd-csi (dldo3)
regulator: shutting down vcc-wifi
axp8xx_pmu0: Disable vcc-wifi (dldo4)
regulator: shutting down eldo2
axp8xx_pmu0: Disable eldo2 (eldo2)
regulator: shutting down eldo3
axp8xx_pmu0: Disable eldo3 (eldo3)
regulator: shutting down vcc-1v2-hsic
axp8xx_pmu0: Disable vcc-1v2-hsic (fldo1)
regulator: shutting down vcc-phyCode:
# ubench -c -t 30
Ubench CPU: 471403
# ubench -m -t 30
Ubench MEM: 131312
# ntpdate ntp.xs4all.nl
4 Aug 00:00:25 ntpdate[634]: adjust time server 194.109.6.2 offset 0.032592 secCode:
last pid: 670; load averages: 0.08, 0.07, 0.02 up 0+08:35:00 14:28:29
11 processes: 1 running, 10 sleeping
CPU: 0.0% user, 0.0% nice, 0.1% system, 0.0% interrupt, 99.9% idle
Mem: 1M Active, 15M Inact, 81M Wired, 32M Buf, 2G Free
Swap:
PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND
670 root 1 20 0 14M 4M CPU0 0 0:00 0.73% top
166 root 4 20 0 21M 5M nanslp 3 0:17 0.00% clusternode
363 root 1 20 0 11M 840K select 3 0:00 0.00% syslogd
294 root 1 20 0 13M 636K select 1 0:00 0.00% devd
605 root 1 20 0 13M 4M pause 3 0:00 0.00% csh
601 freebsd 1 20 0 20M 2M select 2 0:00 0.00% sshd
599 root 1 34 0 20M 7M select 0 0:00 0.00% sshd
602 freebsd 1 29 0 13M 2M pause 1 0:00 0.00% csh
604 freebsd 1 26 0 13M 3M wait 3 0:00 0.00% su
598 root 1 46 0 11M 2M ttyin 0 0:00 0.00% getty
562 root 1 20 0 19M 1M select 1 0:00 0.00% sshdFor clusterboards only!
** It's not and official FreeBSD build! It's from head ~3 weeks ago and I patched/hacked stuff together to make it work more stable for my use our clusterboards at work to avoid using Linux.
*** I'm just a FreeBSD user that is trying to install FreeBSD on about every device I can get my hands on.
-- It's a almost complete buildworld so there should be no problem with compatibility. It's almost a complete FreeBSD aarch64 base with modified drivers in the kernel and a modified DTB. (some already in the process of getting in the next FreeBSD version)
* What works (build-in modules and patched some stuff to work)
- Can boot from eMMC(*patched) and should boot from SD. (didn't test but already should work)
- Can boot with MFS (not in this image but you can change the boot.scr or push settings with dhcp)
- Can boot from PXE(*patched loader.efi to not crash if there is no disk at all -- I think base also already fixed this bug)
- CPU Frequency settings (1248Mhz, 1200Mhz, 1008Mhz, 816Mhz (DEFAULT), 528Mhz) (Fixed in DTB)
- Thermal sensor (Fixed in DTB and added weird factor clock) -- Getting pached in base soon
- DMA Controller (DTB and patched some kernel files)
- SRAM Controller for ethernet only (DTB Mappings)
- SD, eMMC both work but may spit out messages at boot only depending on what you have inserted. (I use PXE+MFS+NFS so less prio)
- Patched ethernet if_awg and rgephy and now only does 1000baseT/full because on the clusterboard that's all we have and we don't need al the extra code anyway. :-)
v1.1 patches
* HS Timer is now usable as kernel timecounter (not active by default)
You can configure countdown with debug dev.a64_hstimer.0.magic-clock (if your osc is out of wack)
Still working on improving it, it now generates 1k interrupts next version I will try and cut it down by a lot.
* Fixed a time jump issue / workaround for main timer hardware bug when it rolls-over not all bits end up as expected.
This workaround also fixes threads hanging randomly on _nanosleep()
If you notice time jumps on a node: enable this with: sysctl kern.timecounter.hardware="A64 HS Timer"
-- also you may want to tweak this for time keeping: sysctl dev.a64_hstimer.0.magic-clock=100004
* Solved the ethernet link dropping issue
* Added gdb from ports. (needed to troubleshoot the thread hanging issue)
* Removed some debug messages I had put in the kernel to find some issues.
* Enabled Invariants, Witness and deadlock resolver in the kernel for troubleshooting. (worthless if you have clock issues but was handy to notice how bad locking in filesystem currently is and made me go to a much simpler PXE boot setup using a more stable MFS as root)
* Completely removed USB support. It's not working anyway.
* Doesn't work
- No framebuffer (can't use/test it on clusterboard) -- It's even removed from the devicetree so don't even try soldering a HDMI connector to your clusterboard! :-)
- USB doesn't seem to be working but I doubt the connection didn't get it working in Linux either. (disabled in dtb and kernel)
- No MALI support what so ever.. regulators for MALI and other stuff are off.
- There is still lots of stuff in the kernel we don't use on the sopine cluster I'd like to remove making the kernel a bit smaller.
* Issues
- Ethernet is fast but not yet 100% stable.. there are a few link drops for a millisecond or so **FIXED in 1.1
- Be careful with mounting stuff on top of other stuff, nullfs, tmpfs and NFS have some weird locking issue (i think only on aarch64?! / FreeBSD 12) a.t.m. However witness will freak out at boot on it a.t.m. which is a bit better then unexpected hangs/deadlocks while in production. :-)
* Image
You can use stuff like pkg install and portsnap but you need to remove the /var (and maybe) /tmp ramdisks first.
-- ports tested: I installed glusterfs from ports with somewhat same build as this so it should work!
-- pkg install: I installed nano from pkg install nano
I have it running on 7 nodes myself using PXE/MFS and NFS and it's getting more stable with every patch. :-)
Next version (v1.2) I hope to also include configs and stuff I use for DHCP/PXE booting the modules so you could use the first node as master sharing eMMS with the 6 other nodes via NFS.. Need to compile stuff like dhcpd first for ARM.
* Login
Login via SSH: sopine/sopine (sopine is in wheel)
Root has no password
https://pastebin.com/fTBxnRBS <- dmesg (little dated)
https://drive.google.com/open?id=1r_J36Z...teieYH08PF <- Image V1.1