Hackweek23:

Offline SUSE Audio Assistant

Hackweek22: Tell OpenAI to read a book

​

Alex Lau 劉俊賢

(AvengerMoJo) alau@suse.com

Abstract

The Overview

​

Demo

Q&A

The Overview

Inspiration

4

​

• Do Not Want to Controlled by OpenAI
• No Money for GPU
• ok Google and Alexa limitation
• Continue Hackweek22 RAG to run it locally without OpenAI

​

​

​

Generated by Stable Diffusion XL

​

The ideas

• First cross platform Audio input : pyAudio
• Second using a fast non gpu AI Speech transcription : faster_whisper
• Third using a fast non gpu AI Text to Speech : coqui.ai TTS
• Fourth think about the workflow:
• Activate : “Hey SUSE” -> AI: Reply : What can I do for you?
• Question: What is the distance between the Sun and Earth?

-> AI: Reply: 'The average distance between the sun and the Earth is approximately 93 million miles (150 million kilometers).'

What to do?

5

The repo

• It run on SUSE Linux TW and MacOS

​

git clone gitea@src.opensuse.org:alexlau/SUSE_audio_assistant.git

cd SUSE_audio_assistant

. setup.sh

python3.11 -m venv venv

pip install -r requirement.txt

python demo_assistant.py

​

https://src.opensuse.org/alexlau/SUSE_audio_assistant

6

The Demo

7

Questions and Answers

257-000041-001

Inspiration

10

​

​

• Ask My Book by Sahil Lavingia
• The site https://askmybook.com/
• The code https://github.com/slavingia/askmybook

​

​

The ideas

• First learn what is happening
• Second implement another demo
• Third explain what is going on
• Fourth think what could be done later

What to do?

11

The Design, The Flow

13

PDF / EPUB

Embeddding

Tokens

14

Embeddding

Tokens

cosine

similarity

Subtext from the book

https://documentation.suse.com/container/all/pdf/SLES-container_color_en.pdf

15

The Demo

16

17

​

Q:Tell me the image size of the BCI-Micro

​

A: The BCI-Micro image size is about 26MB.

​

​

Q: What is BCI

​

A: BCI stands for Base Container Image. It is a minimal SLES 15-based image that can be used to develop, deploy, and share applications.

​

Q: Tell me the link of openjdk

​

A: The link of openjdk is https://registry.suse.com/bci/openjdk/index.html

​

​

Q: What tools is available to build and manage container?

​

A: The tools available to build and manage container are Docker, Podman, and Buildah.

​

Q: What is KIWI for?

​

A: KIWI is a multi-purpose tool for building images. In addition to container images, regular installation ISO images, and images for virtual machines, KIWI can build images that boot via PXE or Vagrant boxes.

​

Questions and Answers

257-000041-001