離開抱抱臉: 讓Dify擁抱Ollama / Leaving Hugging Face: Embracing Ollama with Dify
布丁布丁吃布丁
離開抱抱臉: 讓Dify擁抱Ollama / Leaving Hugging Face: Embracing Ollama with Dify
在「自行架設大型語言模式應用程式:Dify」這篇我講到我在Dify裡面使用Hugging Face API作文字嵌入(embedding),但啟動等待跟限速的限制降低了使用效率。這次我們把文字嵌入的工作交給自行架設的Ollama,讓我們來看看自行架設到底可以帶來什麼效益吧。
In the article "Self-Hosting a Large Language Model Application: Dify," I discussed using the Hugging Face API for text embedding within Dify. However, startup latency and rate limiting reduced efficiency. This time, we'll offload the text embedding task to a self-hosted Ollama instance. Let's explore the benefits of self-hosting.
(more...)
Comments