LiteLLM-MCP-Server

ArtemisAI/LiteLLM-MCP-Server

3.3

If you are the rightful owner of LiteLLM-MCP-Server and would like to certify it and/or have it hosted online, please leave a comment on the right or send an email to dayong@mcphub.com.

LiteLLM MCP Server is a robust Model Context Protocol server designed to facilitate integration between Claude AI and LiteLLM proxy instances, offering comprehensive model management and monitoring capabilities.

Tools
4
Resources
0
Prompts
0

LiteLLM MCP Server

A powerful Model Context Protocol (MCP) server written in TypeScript that enables seamless integration between Claude AI and LiteLLM proxy instances. Manage models, API keys, and monitoring directly through Claude's interface.

🚀 Features

  • Model Management: List and inspect all available models in your LiteLLM instance
  • API Key Generation: Create virtual API keys with custom aliases for rate limiting and monitoring
  • User Management: Organize and manage users and their associated API keys
  • Spend Tracking: Monitor API usage and costs per user
  • Docker Native: Runs as a containerized service with secure stdio communication
  • Seamless Integration: Works directly with VSCode and Claude through MCP protocol

📋 Prerequisites

  • Node.js 18+ or Docker & Docker Compose
  • Running LiteLLM proxy instance (v1.79.0+)
  • PostgreSQL database (for LiteLLM)
  • Redis instance (for caching/rate limiting)
  • VSCode with MCP extension support

🔧 Installation

1. Clone the Repository

git clone https://github.com/ArtemisAI/LiteLLM-MCP-Server.git
cd LiteLLM-MCP-Server

2. Install Dependencies (for local development)

npm install
npm run build

3. Configure Environment

Copy the example configuration and update with your credentials:

cp .vscode/mcp.json.example .vscode/mcp.json

Edit .vscode/mcp.json with your LiteLLM proxy details:

For Docker deployment:

{
  "servers": {
    "litellm-manager": {
      "type": "stdio",
      "command": "docker",
      "args": ["exec", "-i", "litellm_mcp", "node", "dist/index.js"],
      "env": {
        "LITELLM_API_BASE": "http://localhost:4001",
        "LITELLM_MASTER_KEY": "sk-your-api-key",
        "DEBUG": "false"
      }
    }
  }
}

For local Node.js deployment:

{
  "servers": {
    "litellm-manager": {
      "type": "stdio",
      "command": "node",
      "args": ["/path/to/LiteLLM-MCP-Server/dist/index.js"],
      "env": {
        "LITELLM_API_BASE": "http://localhost:4001",
        "LITELLM_MASTER_KEY": "sk-your-api-key",
        "DEBUG": "false"
      }
    }
  }
}

4. Build Docker Image (Optional)

docker build -t litellm_mcp:latest .

5. Run Container (Optional)

docker run -d --name litellm_mcp \
  --network litellm_litellm_network \
  -e LITELLM_API_BASE=http://litellm-llm-1:4000 \
  -e LITELLM_MASTER_KEY=sk-your-key \
  litellm_mcp:latest sleep infinity

6. Enable in VSCode

The MCP server will automatically connect when configured in .vscode/mcp.json. VSCode will discover and register the following tools available in Claude:

🛠️ Available Tools

list_models

List all available models in your LiteLLM instance.

Usage in Claude:

"List the models available in LiteLLM"

Returns: Array of model IDs with metadata

get_model_info

Retrieve detailed information about a specific model.

Parameters:

  • model (string): Model name/ID

Usage in Claude:

"Tell me about the Gem-2.5-flash model"

Returns: Model metadata including owner and creation info

create_virtual_key

Generate a new virtual API key for rate limiting and user management.

Parameters:

  • key_alias (string): Friendly name for the key
  • user_id (string): User identifier to associate

Usage in Claude:

"Create an API key called 'production-app' for user 'app-001'"

Returns: New API key with full configuration

get_spend

Monitor API usage and costs for a specific user.

Parameters:

  • user_id (string): User to check spend for

Usage in Claude:

"Show me the spend for user 'app-001'"

Returns: Usage statistics and cost breakdown

📁 Project Structure

LiteLLM-MCP-Server/
├── src/
│   └── index.ts                 # Main TypeScript MCP server implementation
├── dist/                        # Compiled JavaScript (generated)
│   └── index.js
├── .vscode/
│   ├── mcp.json.example         # Configuration template
│   ├── mcp.docker.json          # Docker configuration template
│   └── mcp.json                 # User config (gitignored)
├── .github/
│   └── FUNDING.yml              # GitHub sponsorship config
├── tests/                       # Test plans and documentation
│   ├── TEST_PLAN.md            # Comprehensive testing strategy
│   └── DOCKER_VS_NPM.md        # Architecture decision docs
├── README.md                    # This file
├── CONTRIBUTING.md              # Contribution guidelines
├── SECURITY.md                  # Security policy
├── DEPLOYMENT.md                # Deployment guide
├── LICENSE                      # MIT License
├── .gitignore                   # Git ignore rules
├── package.json                 # Node.js package metadata
├── tsconfig.json                # TypeScript configuration
└── Dockerfile                   # Container build config

🔐 Security

This project handles sensitive information including API keys and database credentials. Security is paramount.

Key Guidelines

  1. Never commit secrets - Use .vscode/mcp.json.example as a template
  2. Use environment variables - All sensitive data via env vars only
  3. Rotate credentials regularly - Update keys and passwords periodically
  4. Restrict network access - Run on secured networks only
  5. Disable DEBUG mode - Set DEBUG=false in production

Reporting Security Issues

If you discover a security vulnerability, do not open a public issue. Instead, email: daniel@artemis-ai.ca

See for detailed security policies and procedures.

🤝 Contributing

We welcome contributions! Please see for:

  • Code style and standards
  • Testing requirements
  • Pull request process
  • Issue reporting

Quick Start for Contributors

# Fork and clone
git clone https://github.com/YOUR_USERNAME/LiteLLM-MCP-Server.git
cd LiteLLM-MCP-Server

# Create feature branch
git checkout -b feature/your-feature

# Make changes and test
# ... your code ...

# Submit pull request

💰 Support the Project

If you find this project useful, consider supporting it:

  • ⭐ Star on GitHub - Help others discover the project
  • 💬 Contribute - Submit issues and pull requests
  • 🤝 Sponsor - Support ongoing development

📝 License

This project is licensed under the MIT License - see the file for details.

MIT License Summary

✅ Commercial use
✅ Modification
✅ Distribution
✅ Private use
⚠️ Liability
⚠️ Warranty

🔗 Related Projects

📚 Documentation

  • - Full deployment instructions
  • - Security guidelines and vulnerability reporting
  • - How to contribute to the project

📞 Support

🙏 Acknowledgments

  • LiteLLM - Excellent proxy server for LLM APIs
  • Anthropic - Claude AI and MCP protocol
  • OpenAI - ChatGPT and foundation models

Made with ❤️ by ArtemisAI

Last Updated: November 6, 2025