Chat

Build custom chatbots with a just a couple of lines of

LMQL.

Building chat applications is one of the most common use cases for LLMs. This is why LMQL provides simple library support for it. This chapter will walk you through the basics of building a chatbot with LMQL Chat including the core loop, output streaming, serving and defending against prompt injections.

Screenshot of the model dropdown in the playground — An overview of the LMQL Chat library.

To get started choose one of the following topics:

👶🏽 Your first LMQL Chatbot

Learn the basics of LMQL Chat by building a simple chatbot.

🏄‍♀️ Serving your Chatbot

Learn how to serve your chatbot via a WebSockets API.

🧠 Internal Reasoning

Build a chabot with (hidden) internal state and reasoning.

🛡️ Defend against Prompt Injections

Perform input sanitization to defend against prompt injection attacks.