Open-source desktop AI assistant for running local models or connecting to online models.
High-throughput and memory-efficient LLM serving and inference engine.
Open-source AI-native embedding database for document search and LLM context.