Enterprise

For companies that need SSO, user management and professional support for LiteLLM Proxy

info

Interested in Enterprise? Schedule a meeting with us here 👉 Talk to founders

Deploy managed LiteLLM Proxy within your VPC.

Includes all enterprise features.

View AWS Marketplace Listing

Get early access

This covers:

• Enterprise Features
  • Security
    • ✅ SSO for Admin UI
    • ✅ Audit Logs with retention policy
    • ✅ JWT-Auth
    • ✅ Control available public, private routes
    • ✅ [BETA] AWS Key Manager v2 - Key Decryption
    • ✅ IP address‑based access control lists
    • ✅ Track Request IP Address
    • ✅ Use LiteLLM keys/authentication on Pass Through Endpoints
    • ✅ Set Max Request / File Size on Requests
    • ✅ Enforce Required Params for LLM Requests (ex. Reject requests missing ["metadata"]["generation_name"])
  • Customize Logging, Guardrails, Caching per project
    • ✅ Team Based Logging - Allow each team to use their own Langfuse Project / custom callbacks
    • ✅ Disable Logging for a Team - Switch off all logging for a team/project (GDPR Compliance)
  • Spend Tracking & Data Exports
    • ✅ Tracking Spend for Custom Tags
    • ✅ Exporting LLM Logs to GCS Bucket
    • ✅ API Endpoints to get Spend Reports per Team, API Key, Customer
  • Prometheus Metrics
    • ✅ Prometheus Metrics - Num Requests, failures, LLM Provider Outages
    • ✅ x-ratelimit-remaining-requests, x-ratelimit-remaining-tokens for LLM APIs on Prometheus
  • Guardrails, PII Masking, Content Moderation
    • ✅ Content Moderation with LLM Guard, LlamaGuard, Secret Detection, Google Text Moderations
    • ✅ Prompt Injection Detection (with LakeraAI API)
    • ✅ Reject calls from Blocked User list
    • ✅ Reject calls (incoming / outgoing) with Banned Keywords (e.g. competitors)
  • Custom Branding
    • ✅ Custom Branding + Routes on Swagger Docs
    • ✅ Public Model Hub
    • ✅ Custom Email Branding
• ✅ Feature Prioritization
• ✅ Custom Integrations
• ✅ Professional Support - Dedicated discord + slack

Frequently Asked Questions

What topics does Professional support cover and what SLAs do you offer?

Professional Support can assist with LLM/Provider integrations, deployment, upgrade management, and LLM Provider troubleshooting. We can’t solve your own infrastructure-related issues but we will guide you to fix them.

• 1 hour for Sev0 issues
• 6 hours for Sev1
• 24h for Sev2-Sev3 between 7am – 7pm PT (Monday through Saturday)

We can offer custom SLAs based on your needs and the severity of the issue

What’s the cost of the Self-Managed Enterprise edition?

Self-Managed Enterprise deployments require our team to understand your exact needs. Get in touch with us to learn more