Kubernetes on SoPine cluster part.1
So this is a quick guide on how I got Kubernetes installed and running on 5 nodes on a prototype SoPine clusterboard. This can also work on rock64's, pine64(+)/LTS or anything else really. I'm assuming you already know how to flash OS SD card images using your favourite host OS, and can configure a router, in particular assigning manual DHCP addresses to hosts.

This isn't step by step, and if you need clarification, then perhaps go learn about whatever it is first. This is not a beginner's guide.

I recently got the book "Kubernetes Up & Running" (KUAR) by Hightower, Burns & Beda from O'Reilly. It came out in September 2017 so it's fairly current, although with all tech books, there are some things already out of date.

I read the intro and chapter 1 - nice and informative.

Chapter 2 - "you may want to start expriementing" it suggested. Uhhm, yes. "You should use an online service offering" it advised. Uhmm, if I have to ... "If you're really want to set it up yourself ... appendix A has a guide" it revealed. I skipped the rest of Chapter 2 for now. Chapters 3 through Appendix A, I'll get back to later as well


The steps that follow are a rough paraphrase of Appendix A in the KUAR book with a few changes (ie that out of date already stuff)

Step 1- Get hardware.
  • Two or more sopines
  • sopine clusterboard (cheats power cabling, network cabling (has built in  GigE ethernet switch), cable management and all the other hassles of DIY clusters)
Step 2- make a bunch of OS SD cards
  • I used an armbian 5.37 BSP xenial server build, any xenial build should work but stick with the minimal builds as you won't need most of what's in minimal, nevermind anything else
Step 3- network config
  • Rather than installing DHCP tools on the host node, I just plugged them in an booted each sopine up sequentially, and assinged them hosts sopine[0..4] and on my router gave them IP addresses nnn.nnn.nnn.200 through 204 (where n is whatever subnet used on your router. eg or
  • The book assumes the cluster will be isolated and hidden from the world so there are some extra network forwarding steps and configs I completely ignored as the clusterboard has it's own switch directly connected to the 'net and all nodes can see the world. Again this is *not* a production ready setup, where you'd likely have one exposed node, and all your worker nodes hidden/protected in a vlan or simiar. (Have I mentioned this is *not* a production ready setup?)
Step 4- Install Kubernetes stuff
  • (optional) install cssh(X) - Cluster SSH lets you blow up numerous systems at once by ssh'ing into all of them simultaneously and running things all at once. Since I haven't bothered (yet) with config management to setup the sopines, this is even more efficient #BadDevOps than ssh'ing into them individually way of doing things. (Thank you Xalius for introducing this to me!) (csshX is the OSX brew version)
  • install docker.io - this is the default container engine
  • install kubernetes package encryption key:
    curl -s https://packages.cloud.google.com/apt/doc/apt-key.gpg | apt-key add -
  • Add repo to your repo's list
    echo "deb http://apt.kubernetes.io/ kubernetes-xenial main" >> /etc/apt/sources.list.d/kubernetes.list
  • Update and upgrade the nodes
  • install actual kubernetes stuff
    apt install -y kubelet kubeadm kubectl kubernetes-cni
  • this installed version 1.9 on my sopines
Step 5- Setup up the cluster!
  • On the master node (sopine0 in my case) 
    kubeadm init --pod-network-cidr --apiserver-advertise-address
  • Make sure to use the correct network range as you may not be using the same subnet as I. This will take a while. It will also generate the <token> you need to initialise the slave nodes and will actually print out the command for the slave nodes to join the cluster
  • on the slave nodes (sopine[1..n])
    kubeadm join --token=<token> --discovery-token-ca-cert-hash sha256:<hash>
  • if it all played nice then to see your embryonic Kubernetes cluster details
    kubectl get nodes
That's it for now, there are more things to do of course but that's what it takes to get started with (a non production ready) kubernetes cluster on a sopine cluster board.
Cool, I've been wanting to try this for a while - thanks for the write up Smile
I encountered an error with kubernetes last two versions (v1.10.0 and v1.10.1). I was only able to make it work with v1.9.6.

So if anyone has the same issue, you can replace the kubernetes installation of @maya.b with : 

apt-get -y install kubectl=1.9.6-00 kubelet=1.9.6-00 kubernetes-cni=0.6.0-00 kubeadm=1.9.6-00

I had no issue with everything else  Smile
Yes - Kubeadm currently has a blocking issue with Kubernetes releases above >1.9.8 (including 1.10.x). Note that this is affecting ALL bare metal installs of Kubernetes, not just Pine boards.

The issue is with the installer (kubeadm) and not Kubernetes itself. You should be able to install/launch your cluster and then upgrade to 1.10.x using “apt upgrade” on each node in the cluster (suggest upgrading the master node last).

Possibly Related Threads…
Thread Author Replies Views Last Post
  SOPine modules stay off at reboot? PeterKeuning 27 6,387 04-25-2021, 07:56 PM
Last Post: dsimic
  What's the point of a cluster? guenther 2 219 04-07-2021, 10:49 AM
Last Post: guenther
  Add ordinary so-dimm memory to cluster slot? fxSol 1 273 03-02-2021, 03:54 AM
Last Post: poVoq
  Is my wooden desk a safe surface to test the cluster board on? ollehar 6 2,106 12-28-2020, 09:41 AM
Last Post: robocone
  Building a new cluster with external storage hvdkooij 2 847 11-20-2020, 07:44 AM
Last Post: hvdkooij
  Compatibility between RPi Module and Cluster board leperotero 1 809 11-03-2020, 03:40 PM
Last Post: poVoq
  sopine socket power problem cgiraldo 1 1,101 06-17-2020, 02:10 PM
Last Post: cgiraldo
  Is there any way to get a video output from a cluster module? ollehar 4 2,272 06-16-2020, 12:34 PM
Last Post: ollehar
  What kind of box would be able to host both the cluster board and a RockPro64? ollehar 1 1,276 06-14-2020, 05:37 PM
Last Post: tllim
  What's the ceramic cubic part? ollehar 3 1,929 06-07-2020, 04:13 PM
Last Post: pfeerick

Forum Jump:

Users browsing this thread: 1 Guest(s)