Last month we shared about Jdaie Lin’s offline chatbot. Well now they are back with a new and improved version, sort of. Nothing about the hardware has changed, Lin found ways to improve the speed of the software stack by optimizing the ASR, LLM and TTS. From the ASR alone they were able to improve the speed by about 6.5 seconds! If you aren’t committed to running on a single Pi, they also demonstrate how they split up the workload with a docker system.
Three months ago, I built an offline AI chatbot on a Raspberry Pi 5.
It worked — but it wasn’t exactly fast.Today, it feels completely different.
And here’s the key part: this is still the exact same Raspberry Pi 5.In this video, I’ll show how I dramatically improved the chatbot’s speed
by optimizing the software pipeline — no extra accelerators, no cloud APIs.
Be sure to check out our posts, tutorials and new Raspberry Pi related products. Adafruit has the largest and best selection of Raspberry Pi accessories and all the code & tutorials to get you up and running in no time!
from Adafruit Industries – Makers, hackers, artists, designers and engineers! https://ift.tt/A4R9Ka7
via IFTTT
Комментариев нет:
Отправить комментарий