Nightly can be configured by advanced testers to use custom prompts and any compatible chatbot, such as llamafile, which runs on-device open models, including open-source ones. We are excited for the community to share interesting prompts, chatbots, and models as we make this a better user experience. We are also looking at how we can provide an easy-to-set-up option for a private, fully local chatbot as an alternative to using third-party providers.
I think they could’ve waited until they properly tried implementing a local llm. Anyway glad to know that we have options and gonna try this.
Glad they also started to include images which makes easy to really understand the changes, especially the UI related ones.