vtube-studio-plugin-mcp-server

hkopenai/vtube-studio-plugin-mcp-server

3.3

If you are the rightful owner of vtube-studio-plugin-mcp-server and would like to certify it and/or have it hosted online, please leave a comment on the right or send an email to henry@mcphub.com.

The VTube Studio MCP Server is a plugin that integrates VTube Studio with the Model Context Protocol (MCP) for enhanced communication and control of Live2D parameters.

VTube Studio MCP Server

Overview

The VTube Studio MCP Server is a plugin designed to integrate VTube Studio with the Model Context Protocol (MCP). This server facilitates communication between VTube Studio and other MCP-compatible applications, allowing for the retrieval and manipulation of Live2D parameters directly from VTube Studio.

Features

  • WebSocket Connection: Establishes a WebSocket connection to VTube Studio for real-time communication.
  • Authentication: Handles authentication with VTube Studio, including token management for secure access. When the MCP server connects to VTube Studio, it requests authentication. If no stored token is available or if the stored token is invalid, a new token is generated by VTube Studio. The user must approve this authentication request within VTube Studio, after which the token is sent to the MCP server for secure communication. This token can optionally be stored for future sessions, based on the server's configuration.
  • Live2D Parameters Retrieval: Provides a tool to fetch Live2D parameters from VTube Studio, enabling dynamic control and interaction.
  • Token Storage Option: Offers the flexibility to start the server without storing the authentication token to a file, enhancing security in certain use cases.

Installation

To install the VTube Studio MCP Server, follow these steps:

  1. Ensure you have Node.js installed on your system.
  2. Clone this repository or download the source code.
  3. Navigate to the project directory and run: 
    npm install
  4. Start the server with: 
    npm start

Usage

Starting the Server

To start the server with default settings (token storage enabled):

npm start

To start the server without storing the authentication token:

node dist/index.js --no-store-token

Configuration

The server can be configured through the MCPServerOptions interface. Key options include:

  • name: The name of the MCP server.
  • description: A brief description of the server's purpose.
  • version: The version of the server.
  • storeToken: A boolean flag to enable or disable token storage (default is true).

Tools

  • Activate Expression: Activates a specific expression for the current model in VTube Studio.
  • Add Custom Parameter: Adds a custom parameter to the current model for advanced control.
  • API Server Discovery: Listens for VTube Studio API state broadcasts on the local network via UDP (currently a placeholder for UDP functionality).
  • Check Face Found: Checks if a face is currently detected by VTube Studio's tracking system.
  • Control Expression: Controls the state or intensity of expressions for the current model.
  • Control Item Animation: Manages animation settings for items in the scene.
  • Delete Custom Parameter: Removes a custom parameter from the current model.
  • Get Art Mesh List: Retrieves a list of Art Meshes for the current model, useful for customization.
  • Get Available Models: Lists all available models that can be loaded into VTube Studio.
  • Get Current Model: Retrieves information about the currently loaded model in VTube Studio.
  • Get Current Model Physics: Gets the physics settings for the current model.
  • Get Expression States: Retrieves the current state of expressions for the model.
  • Get Hotkeys: Lists available hotkeys configured in VTube Studio.
  • Get Item List: Retrieves a list of items currently in the scene.
  • Get Live2D Parameters: Retrieves Live2D parameters from VTube Studio for dynamic control.
  • Get Parameter Value: Gets the current value of a specific parameter in VTube Studio.
  • Get Post Processing List: Retrieves a list of available post-processing effects.
  • Get Scene Color Overlay Info: Retrieves information about the scene color overlay, such as lighting settings.
  • Get Tracking Parameters: Gets parameters related to face or body tracking in VTube Studio.
  • Get VTS Folders: Retrieves folder paths or configurations used by VTube Studio.
  • Get VTS Statistics: Fetches usage statistics or performance data from VTube Studio.
  • Inject Parameter Data: Injects or updates parameter data into VTube Studio for custom control.
  • Load Item Into Scene: Loads a specific item into the current scene in VTube Studio.
  • Load Model: Loads a specified model into VTube Studio.
  • Move Item In Scene: Adjusts the position or properties of an item within the scene.
  • Move Model: Changes the position or rotation of the current model in the scene.
  • NDI Config: Manages NDI (Network Device Interface) configuration for streaming or output.
  • Pin Item To Model: Pins an item to a specific part of the model for synchronized movement.
  • Remove Item From Scene: Removes a specified item from the current scene.
  • Request API Permissions: Requests specific API permissions from the user for accessing certain functionalities.
  • Select Art Meshes: Selects specific Art Meshes for manipulation or customization.
  • Set Current Model Physics: Updates or overrides the physics settings for the current model.
  • Set Post Processing Effects: Applies or modifies post-processing effects in VTube Studio.
  • Subscribe To Events: Subscribes to specific events or updates from VTube Studio for real-time monitoring.
  • Tint Art Meshes: Applies color tinting to selected Art Meshes for visual customization.
  • Trigger Hotkey: Triggers a specific hotkey action configured in VTube Studio.

Project Structure

  • src/: Contains the source code for the server.
    • index.ts: Entry point for the application.
    • mcp-server.ts: Core MCP server implementation.
    • tools/: Contains tools like getLive2DParameters.ts for specific functionalities.
    • utils/: Utility functions, including authenticate.ts for handling authentication.
  • test/: Contains unit tests for various components of the server.
  • dist/: Compiled JavaScript output from TypeScript source.

Testing

Run the unit tests with:

npm test

This will execute all tests in the test/ directory using Mocha.

Contributing

Contributions are welcome! Please submit issues or pull requests on the project's GitHub page for any bugs, features, or improvements.

License

This project is licensed under the MIT License - see the LICENSE file for details.

Contact

For support or inquiries, please contact the project maintainers through GitHub issues.