Kalliope Voice Assistant on Mobian
#1
I have successfully ported the Kalliope voice assistant, https://kalliope-project.github.io/ , to the latest Mobian build, The process was fairly straightforward though the default trigger did have to be replaced with Mycroft Precise.

Add non-free to the Debian Bullseye entry in the apt sources.list config file.
Follow the kalliope install instructions for Debian Jessie
Install a starter kit
Install the precise trigger code for kalliope https://github.com/corus87/kalliope_trigger_precise
Configure trigger word
Start configuring your voice activated services!

HTH
LF
#2
That sounds very interesting,  does that require outside server/computer assistance to function, or is everything on your device.?

If it is just a voice interface to a Google/Amazon/Apple type of super computer,  then thanks, but No Thanks.
      LINUX = CHOICES
         **BCnAZ**
               Idea
   Donate to $upport
your favorite OS Team
#3
Default is google but you seem to be able to switch to another STT: https://github.com/kalliope-project/kall...ettings.md
#4
Smile 
No server is required, anywhere. The only outside service required at this time is a STT (speech to text) converter. Currently the most reliable is google. The local STT (CMUSphinx) is only usable by experts. While the use of Google for STT is not the best, it is not as big privacy leak as it appears. All google does in this case is recognize the words. Google does not know what actions are taken due to the words. This is very unlike any of the proprietary VA's as they do voice recognition and application execution. The framework is easily extensible and there are multiple STTs and TTSs available.

For example I have six URLs for internet radio.
Sheila, play radio alberta
Google will see the words play radio alberta but has no idea what radio station I am listening

I am currently building a neuron to make phone calls via voice command
Sheila, call Bob
Since google has no access to my contacts, google does not know who I am calling

I use the program on my home media machine as an Alexa/Google/Siri alternative. It is in a state very similar to the pinephone, it works, but it takes work to make it work. Smile

HTH
LF
#5
Working phone call neuron. Add to the brains directory as phone.yml

- name: "make_phonecall"
  signals:
  - order: "phone {{ person }}"
  neurons:
  - say:
      message: "Calling {{ person }}"
  - shell:
      cmd: "gnome-calls --dial {{ contacts[person] }}"
      async: TRUE


Currently the contact phone numbers are manually stored within Kalliope. Next is to query gnome-contacts or evolution for the phone numbers. Please note that the only data sent to google are the phonic representation of "phone" and the phonic representation of "person."

The biggest issue right now is the wakeword detector runs 100% of the time. Not a problem as a desktop hosted service. I have hacked a shutdown after 60 seconds of inactivity but it is irritating to have to wait for the application to load and restart. Talking to the kalliope devs about various ideas.

HTH
LF
#6
(11-08-2020, 02:33 PM)Lousy Fisherman Wrote: The biggest issue right now is the wakeword detector runs 100% of the time. Not a problem as a desktop hosted service. I have hacked a shutdown after 60 seconds of inactivity but it is irritating to have to wait for the application to load and restart. Talking to the kalliope devs about various ideas.

HTH
LF
I have submitted an upstream enhancement that will suspend the wakeword detector after a user defined period of time along with an desktop icon that sends a signal 18 (SIGCONT) to wake the detector up. This reduces CPU usage while idle from roughly 80% to 3%

HTH
LF
#7
And I have successfully built on Arch and Manjaro.

# load system python libraries
pacman -S python-gitpython python-pyaml python-pyaudio python-six python-markupsafe python-pyasn1 python-ansible
pacman -S python-jinja python-flask python-requests python-httpretty python-mock python-packaging python-sounddevice
pacman -S python-paho-mqtt python-gevent

The Arch package svox-pico-bin has not been ported to aarch64 yet. So I hacked the Debian versions to fit.
Grab the Debian aarch64 library packages from https://packages.debian.org/bullseye/all/
libttspico-data
libttspico-utils
libttspico0

I did the following on an x86 Arch machine as I have not built debtap on aarch64
debtap each package. During the build edit each package name and remove the "-git" from it
Additionally, while editing the build file for libttspico0 change aarch64/gnu/linux/glibc to just glibc
pacman -U the files produced by debtap. The order matters, first data, then the lib, then utils
The library files will be in /usr/lib/aarch64-gnu-linux. Move them to /usr/lib

sudo pacman -U ./libttspico-data-
sudo pacman -U ./libttspico0-
sudo pacman -U ./libttspico-utils-

sudo cp /usr/lib/aarch64-gnu-linux/libttspico* /usr/lib
sudo pip install precise_runner
sudo pip install kalliope    (wait, it is a 1 hour build now, down from 3 Smile
get the starter kit for your language
https://kalliope-project.github.io/starter_kit.html

kalliope install --git-url https://github.com/corus87/kalliope_trigger_precise.git

Configure and .....

"Sheila"
"Yes Boss"
"Phone Jim"
"Calling Jim"
......

Working on integrating location, so that queries like "tell me where the closest something is" will work.

Since I have Kalliope working on Arch/Manjaro I am dropping the Mobian work. I really don't want to but too many of the libraries in Debian are archaic, to put it politely, and  not suitable for a bleeding edge (amputee ward?) system like the Pinephone.

YMMV
LF


Possibly Related Threads…
Thread Author Replies Views Last Post
  bookworm vs trixie discussion for mobian in pinephone regular. zetabeta 15 1,514 03-25-2024, 09:07 AM
Last Post: anonymous
  cant verify mobian image at website gnugpg penguins_rule 0 70 03-18-2024, 08:54 PM
Last Post: penguins_rule
  mobian installed to eMMC - how to install tow-boot grump_fiddle_reinstall 6 1,710 11-22-2023, 11:46 AM
Last Post: aLoop100o
  What actions needed to keep on mobian testing user641 3 1,687 09-05-2023, 06:44 AM
Last Post: Zebulon Walton
  Mobian boot failed with zstd message after upgrade. Mahgue 0 580 09-01-2023, 11:29 AM
Last Post: Mahgue
  how to update mobian over tor vusra 13 6,540 07-09-2023, 08:57 PM
Last Post: vusra
  opensnitch outbound firewall now works on mobian vusra 2 1,798 07-09-2023, 01:37 AM
Last Post: vusra
  Using Nativefier on PP64 with Mobian paulcarton 0 577 07-05-2023, 03:57 AM
Last Post: paulcarton
  Has anyone got briar-desktop running on mobian? vusra 5 2,861 06-19-2023, 03:02 PM
Last Post: vusra
  Axolotl on PinePhone / Mobian arno_nuehm 219 160,119 03-26-2023, 01:49 AM
Last Post: shulamy

Forum Jump:


Users browsing this thread: 1 Guest(s)