The github page you link says "Kernel v3.5 or newer is required. Kernel headers or the build tree for the running kernel are required." We have all this in place with the Ubuntu or Debian images (Kernel 3.10.102+ and headers). So if you follow the manual build instructions to get a package for arm64, where does it fail?
Come have a chat in the Pine IRC channel >>