Chat with local LLMs using n8n and Ollama

In today's fast-paced world, manually interacting with Large Language Models (LLMs) can be a tedious and time-consuming process. Professionals often find themselves switching between different platforms to input queries and retrieve responses, leading to frustration and inefficiency. The n8n workflow 'Chat with local LLMs using n8n and Ollama' addresses this pain point by providing a centralized chat interface. This means no more juggling multiple tools or waiting for slow response times—just quick, direct communication with your self-hosted LLMs.

This n8n workflow operates through a series of well-defined steps using the chatTrigger, lmChatOllama, and chainLlm nodes. When a user sends a chat message, the chatTrigger node captures this input. The prompt is then forwarded to the lmChatOllama node, which interfaces directly with your local LLMs managed by Ollama. Once the LLM processes the input, the response is sent back through the chainLlm node, completing the data flow and delivering the AI-generated reply back to the user in real-time.

This workflow is particularly beneficial for developers, researchers, and data scientists who frequently need to interact with LLMs for various applications. For instance, a data scientist might use it to generate predictive text for project reports, while a developer could utilize it to refine chatbot responses during testing. Additionally, creative writers can engage in brainstorming sessions with the LLM, making it a versatile tool across different industries.

Getting started with this template is straightforward. Simply deploy it in your n8n environment, utilize FlowEngine for easy customization, and adapt the workflow to fit your specific needs. Once set up, you'll be able to interact with your local LLMs effortlessly, enhancing your productivity and creativity.