Kalliope Voice Assistant on Mobian
I have successfully ported the Kalliope voice assistant, https://kalliope-project.github.io/ , to the latest Mobian build, The process was fairly straightforward though the default trigger did have to be replaced with Mycroft Precise.

Add non-free to the Debian Bullseye entry in the apt sources.list config file.
Follow the kalliope install instructions for Debian Jessie
Install a starter kit
Install the precise trigger code for kalliope https://github.com/corus87/kalliope_trigger_precise
Configure trigger word
Start configuring your voice activated services!

That sounds very interesting,  does that require outside server/computer assistance to function, or is everything on your device.?

If it is just a voice interface to a Google/Amazon/Apple type of super computer,  then thanks, but No Thanks.
   Donate to $upport
your favorite OS Team
Default is google but you seem to be able to switch to another STT: https://github.com/kalliope-project/kall...ettings.md
No server is required, anywhere. The only outside service required at this time is a STT (speech to text) converter. Currently the most reliable is google. The local STT (CMUSphinx) is only usable by experts. While the use of Google for STT is not the best, it is not as big privacy leak as it appears. All google does in this case is recognize the words. Google does not know what actions are taken due to the words. This is very unlike any of the proprietary VA's as they do voice recognition and application execution. The framework is easily extensible and there are multiple STTs and TTSs available.

For example I have six URLs for internet radio.
Sheila, play radio alberta
Google will see the words play radio alberta but has no idea what radio station I am listening

I am currently building a neuron to make phone calls via voice command
Sheila, call Bob
Since google has no access to my contacts, google does not know who I am calling

I use the program on my home media machine as an Alexa/Google/Siri alternative. It is in a state very similar to the pinephone, it works, but it takes work to make it work. Smile

Working phone call neuron. Add to the brains directory as phone.yml

- name: "make_phonecall"
  - order: "phone {{ person }}"
  - say:
      message: "Calling {{ person }}"
  - shell:
      cmd: "gnome-calls --dial {{ contacts[person] }}"
      async: TRUE

Currently the contact phone numbers are manually stored within Kalliope. Next is to query gnome-contacts or evolution for the phone numbers. Please note that the only data sent to google are the phonic representation of "phone" and the phonic representation of "person."

The biggest issue right now is the wakeword detector runs 100% of the time. Not a problem as a desktop hosted service. I have hacked a shutdown after 60 seconds of inactivity but it is irritating to have to wait for the application to load and restart. Talking to the kalliope devs about various ideas.

(11-08-2020, 02:33 PM)Lousy Fisherman Wrote: The biggest issue right now is the wakeword detector runs 100% of the time. Not a problem as a desktop hosted service. I have hacked a shutdown after 60 seconds of inactivity but it is irritating to have to wait for the application to load and restart. Talking to the kalliope devs about various ideas.

I have submitted an upstream enhancement that will suspend the wakeword detector after a user defined period of time along with an desktop icon that sends a signal 18 (SIGCONT) to wake the detector up. This reduces CPU usage while idle from roughly 80% to 3%

And I have successfully built on Arch and Manjaro.

# load system python libraries
pacman -S python-gitpython python-pyaml python-pyaudio python-six python-markupsafe python-pyasn1 python-ansible
pacman -S python-jinja python-flask python-requests python-httpretty python-mock python-packaging python-sounddevice
pacman -S python-paho-mqtt python-gevent

The Arch package svox-pico-bin has not been ported to aarch64 yet. So I hacked the Debian versions to fit.
Grab the Debian aarch64 library packages from https://packages.debian.org/bullseye/all/

I did the following on an x86 Arch machine as I have not built debtap on aarch64
debtap each package. During the build edit each package name and remove the "-git" from it
Additionally, while editing the build file for libttspico0 change aarch64/gnu/linux/glibc to just glibc
pacman -U the files produced by debtap. The order matters, first data, then the lib, then utils
The library files will be in /usr/lib/aarch64-gnu-linux. Move them to /usr/lib

sudo pacman -U ./libttspico-data-
sudo pacman -U ./libttspico0-
sudo pacman -U ./libttspico-utils-

sudo cp /usr/lib/aarch64-gnu-linux/libttspico* /usr/lib
sudo pip install precise_runner
sudo pip install kalliope    (wait, it is a 1 hour build now, down from 3 Smile
get the starter kit for your language

kalliope install --git-url https://github.com/corus87/kalliope_trigger_precise.git

Configure and .....

"Yes Boss"
"Phone Jim"
"Calling Jim"

Working on integrating location, so that queries like "tell me where the closest something is" will work.

Since I have Kalliope working on Arch/Manjaro I am dropping the Mobian work. I really don't want to but too many of the libraries in Debian are archaic, to put it politely, and  not suitable for a bleeding edge (amputee ward?) system like the Pinephone.


Possibly Related Threads…
Thread Author Replies Views Last Post
  What do you use for voice chat on Mobian? ragreenburg 6 243 8 hours ago
Last Post: ragreenburg
  Mobian repository status henrythemouse 5 405 Yesterday, 04:23 AM
Last Post: biketool
  Pure Maps GPS on Pinephone Mobian godzillest 3 156 Yesterday, 03:07 AM
Last Post: mouffa
  Keyboard stopped working on disk encryption screen on Mobian after update cowsay 0 52 07-28-2021, 05:46 PM
Last Post: cowsay
  Wipe function on mobian? Wahtone 5 362 07-28-2021, 06:18 AM
Last Post: biketool
  Axolotl on PinePhone / Mobian arno_nuehm 105 28,220 07-23-2021, 01:20 PM
Last Post: Zebulon Walton
  Dark theme (on Mobian)? TRS-80 6 358 07-14-2021, 01:35 PM
Last Post: biketool
  (Gnome) Maps won't start on Mobian? TRS-80 3 267 07-11-2021, 12:09 PM
Last Post: TRS-80
  Mobian Constant Vibration tumblingdog 4 843 07-10-2021, 02:40 AM
Last Post: aed
  Mobian not updating via Software app FOSSagent0 5 620 07-08-2021, 07:37 PM
Last Post: tophneal

Forum Jump:

Users browsing this thread: 1 Guest(s)