Explore the extensive capabilities of Open WebUI, designed to enhance your experience with large language models (LLMs) and streamline your workflows. From seamless integration to enhanced customization, Open WebUI offers a robust set of tools and features across various categories.
Effortless Setup & Integration
Effortless Installation:
Open WebUI can be easily installed using Docker or Kubernetes (kubectl, kustomize, or Helm), with support for both Ollama and CUDA-tagged images. This ensures a smooth and hassle-free setup, allowing you to get started quickly.
OpenAI API Integration:
Effortlessly connect OpenAI-compatible APIs to Open WebUI, enabling diverse conversational capabilities with Ollama models. The OpenAI API URL can be customized to integrate with a variety of third-party applications for enhanced flexibility.
Pipelines Framework:
Open WebUI provides a modular plugin framework that supports the integration of Python libraries, enabling you to add custom logic for AI agents, home automation, and more. Pipelines can be easily uploaded directly from the Admin Panel, making pipeline management straightforward.
Chat & User Experience
Responsive Design:
Open WebUI delivers a seamless user experience across all devices, including desktops, laptops, and mobile devices, ensuring accessibility everywhere.
Progressive Web App (PWA):
The platform offers a native PWA experience with offline access on localhost or a personal domain. While setting up a PWA requires knowledge of Linux, Docker, and reverse proxies like Nginx or Caddy, Open WebUI simplifies deployment, allowing for secure HTTPS integration.
Full Markdown & LaTeX Support:
Enhance your interactions with comprehensive Markdown and LaTeX capabilities, perfect for rich formatting and mathematical equations.
Role-Based Access Control (RBAC):
Ensure secure access by limiting permissions to authorized users. Only administrators can create or modify models, adding an extra layer of protection.
Internationalization (i18n):
Experience Open WebUI in multiple languages with ongoing efforts to expand language support. Users and contributors are encouraged to join in supporting additional languages.
Persistent Settings & Unified Workspace:
User settings are stored in a config.json file, ensuring a personalized experience across sessions. The unified workspace consolidates all models, prompts, and documents in one location, streamlining workflow.
Model Management & Customization
Model Builder:
Easily create and edit models within Open WebUI’s workspace. The platform also supports custom characters, agents, and integration with the Open WebUI Community for importing models.
Concurrent Model Utilization:
Engage with multiple models simultaneously, leveraging their unique strengths to provide optimal responses during chat interactions.
Model Tagging & Selector Features:
Organize your models using tags, and easily find them with a model selector that includes search functionality, tags, and descriptions.
Advanced Parameters:
Gain full control over model parameters such as temperature, frequency penalty, and seed to fine-tune responses.
GGUF File Model Creation:
Upload GGUF files directly into Open WebUI from the Admin Settings, streamlining the process of building models.
Model Playground (Beta):
Experiment with different models and test capabilities in a sandbox environment before deploying them in live chats.
Retrieval Augmented Generation (RAG) & Web Integration
Local and Remote RAG Support:
Open WebUI integrates Retrieval Augmented Generation (RAG) technology for enhanced document processing. Documents can be loaded and accessed using the # symbol in queries, enriching the chat experience with real-time data integration.
Web Search for RAG:
Incorporate results from various web search providers directly into your RAG workflow, allowing for dynamic and contextually relevant responses.
Web Browsing Capabilities:
Integrate websites into your chats by using the # command followed by a URL, creating a richer conversational experience with real-time web content.
YouTube RAG Pipeline:
Summarize YouTube videos by entering the URL directly into your chat. The dedicated RAG pipeline simplifies interaction with video transcriptions.
Citations in RAG:
Track document sources easily with citations integrated directly into responses, ensuring reliable reference points during interactions.
Image Generation & Multi-Modal Support
Image Generation Integration:
Seamlessly incorporate image generation tools into your chat environment, allowing for dynamic visual content to be created alongside text.
Multi-Modal Model Support:
Engage with multi-modal models, such as those that process both text and images (e.g., LLaVA), allowing for richer, more interactive conversations.
Collaboration & Functionality
Local Chat Sharing:
Efficiently share chat links between users for improved collaboration. Whether for feedback or continuing a discussion, sharing is seamless within Open WebUI.
Function Calling:
Enhance LLM interactions by integrating Function Calling, enabling more advanced, programmatic responses.
Conversation Cloning & Tagging:
Clone chats with a single click for future reference, or tag conversations for easy categorization and retrieval.
Memory Feature:
Manually add important information you want LLMs to remember, ensuring continuity in interactions over time.
Rate Limiting & Real-Time Monitoring:
Manage API usage with built-in rate limiting features, and monitor message statistics in real time using Langfuse.
Security & Safety Features
Toxic Message Filtering:
Ensure safe and productive interactions by filtering out harmful messages automatically with the Detoxify pipeline.
LLM-Guard:
This pipeline protects your models against prompt injection attacks and data leaks by detecting and preventing malicious inputs.
Updates & Continuous Improvement
Regular Updates:
Open WebUI is constantly evolving, with frequent updates that introduce new features, fixes, and optimizations.
Changelog & Update Checker:
Easily access the latest changes and features from the Settings menu, and quickly check for updates to keep your system running smoothly.
Key Administrative Features of Open WebUI
Open WebUI includes robust administrative tools designed to simplify user management, enforce security protocols, and provide control over access and customization. Below are the key features categorized to streamline your administration experience.
User Management & Permissions
Super Admin Assignment:
The first sign-up automatically becomes the super admin with an unchangeable role. This role cannot be modified by anyone else, ensuring a top-level administrative position is always protected.
Granular User Permissions:
Manage user access with highly customizable, role-based permissions. This system ensures that only authorized users can perform specific tasks, providing tailored access control across the platform.
Multi-User Management:
Admins can effortlessly manage users using a panel equipped with pagination for large user groups. Add users directly or via CSV import for efficient onboarding, allowing easy administration of user life-cycles.
Default Sign-Up Role:
Control the user flow by assigning default roles to new sign-ups, including options such as pending, user, or admin roles. This flexibility helps manage access permissions and workflows for new users.
Active Users Indicator:
Monitor which users are active and which models are being utilized. This feature assists in assessing performance impacts, particularly when the platform is being used by a large number of people.
Prevent New Sign-Ups:
Restrict access by disabling new user sign-ups when needed, maintaining a fixed user base and keeping control over the platform’s growth.
Access Control & Security
Prevent Chat Deletion:
Admins can toggle a setting that prevents users from deleting chat messages. This ensures the retention of messages for compliance, audits, or internal reviews.
Model Whitelisting:
Admins can whitelist specific models for certain user roles, ensuring only authorized individuals can access sensitive or restricted models.
Admin Control for Community Sharing:
Enable or disable community sharing for users through a toggle in the Admin Panel. This gives admins full control over the visibility and accessibility of user-generated content in the wider community.
Trusted Email Authentication:
Enhance security by enabling trusted email header authentication, adding an extra layer of verification and protection for your Open WebUI instance.
Backend Reverse Proxy Support:
Strengthen security with reverse proxy support, allowing secure communication between Open WebUI’s backend and Ollama without exposing it over the local area network (LAN).
Authentication Control:
While Open WebUI does not support federated authentication (SSO, OAuth, SAML, or OIDC) natively, admins can configure the platform to work with an authenticating reverse proxy, enabling a Single Sign-On (SSO) experience. Alternatively, admins have the option to disable authentication for demos or fresh installs by setting WEBUI_AUTH to False.
Notifications & Webhooks
Webhook Integration:
Subscribe to real-time events, such as new user sign-ups, through webhook integrations with popular platforms like Discord, Google Chat, Slack, and Microsoft Teams.
Configurable Notification Banners:
Admins can create customizable notification banners for logged-in users. These banners can display important information using configurable colors (info, warning, error, or success) and include options for persistent visibility or dismissibility.
Open WebUI is designed to provide an intuitive, powerful, and highly customizable interface for working with large language models. Whether you’re managing models, generating conversations, or integrating cutting-edge RAG technology, Open WebUI empowers you to optimize every aspect of your AI interactions.