Introducing the Nextcloud Assistant: your fully local, on-premises, open source AI Assistant - an industry first!We built the AI Assistant using a flexible, ...
We build the AI Assistant using a flexible, solution-independent approach which gives you a choice between multiple large language models (LLM) and services. It can be fully hosted within your instance, processing all requests in-house, or powered by an external service.
So it sounds like you pick what works for you. I’d guess on a raspberry pi, on board processing would be both slow and poor quality, but I’ll probably give it a go anyway.
Some of the other Nextcloud stuff (like that chat stuff) isn’t suitable on Raspberry Pi, I expect this will be the same. It’s released though, right? Might have to have a play.
The blog post states:
So it sounds like you pick what works for you. I’d guess on a raspberry pi, on board processing would be both slow and poor quality, but I’ll probably give it a go anyway.
Yeah sorry I was specifically referring to the on prem LLM if that wasnt clear, and how much juice running that thing takes.
Some of the other Nextcloud stuff (like that chat stuff) isn’t suitable on Raspberry Pi, I expect this will be the same. It’s released though, right? Might have to have a play.
You’d be surprised at how little computing power it can take, depending on the LLM.