jcrawl4ai-mcp-server

jcrawl4ai-mcp-server

3.5

jcrawl4ai-mcp-server is a Java-based MCP server for interacting with the Crawl4ai API, enabling web crawling with specified parameters.

jcrawl4ai-mcp-server is a Spring Boot-based MCP server designed to interact with the Crawl4ai API for web crawling tasks. It allows users to crawl specified URLs using a defined strategy, maximum depth, and output format. The server also provides functionality to retrieve crawl results using a task ID. Configuration is done through the application.properties file, where users can set the base URL and API token for the Crawl4ai server. The project relies on libraries such as Spring AI MCP Server, Spring Boot, and Hutool. Users can build and run the project using Maven, and the server logs are stored in a specified log file. The server configuration supports auto-approval of crawl and task commands, with a specified timeout and transport type.

Features

  • Web Crawling: Allows crawling of specified URLs with a defined strategy and depth.
  • Task Management: Retrieve crawl results using a task ID.
  • Spring Boot Integration: Built on Spring Boot for robust server capabilities.
  • Configurable: Easily configure server settings through application.properties.
  • Logging: Maintains logs for server activities in a specified log file.