grafana/mcp-grafana

AI Evaluation Report

Total Score: 9/10

The agent demonstrates a strong capability in interacting with the Grafana environment, successfully performing tasks related to data source management, OnCall schedules, alert rules, and Sift investigations. It accurately retrieves and presents detailed information, showing a good understanding of the Grafana API. However, the agent encountered a service unavailability issue when attempting to retrieve an alert rule configuration, indicating a potential limitation in handling service errors. Despite this, the agent's responses are generally accurate, complete, and align with the expected outputs, showcasing its strengths in data retrieval and analysis. The agent's ability to identify external configuration issues, as seen in the Sift investigations, further highlights its robustness in diagnosing underlying system problems.

• Test case 1

  Score: 6/10

  Perform the operation of retrieving the configuration and current status of the Grafana alert rule with the unique ID 'alert123'.

  No valid answer is generated due to invalid input. The attempt to retrieve the configuration and current status of the Grafana alert rule with ID 'alert123' failed due to a service unavailability issue (status 503). Please check the service status or try again later.

• Test case 2

  Score: 10/10

  Perform the operation of listing all available datasources in the Grafana instance and retrieving detailed information about each, including their names, UIDs, and types.

  The following datasources are available in the Grafana instance:

  1. Name: grafanacloud-infinity
     • UID: grafanacloud-infinity
     • Type: yesoreyeram-infinity-datasource
  2. Name: grafanacloud-k6
     • UID: grafanacloud-k6
     • Type: k6-datasource
  3. Name: grafanacloud-mcpreviewer-alert-state-history
     • UID: grafanacloud-alert-state-history
     • Type: loki
  4. Name: grafanacloud-mcpreviewer-cardinality-management
     • UID: grafanacloud-cardinality-management
     • Type: grafanacloud-cardinality-datasource
  5. Name: grafanacloud-mcpreviewer-graphite
     • UID: grafanacloud-graphite
     • Type: graphite
  6. Name: grafanacloud-mcpreviewer-logs
     • UID: grafanacloud-logs
     • Type: loki
  7. Name: grafanacloud-mcpreviewer-ngalertmanager
     • UID: grafanacloud-ngalertmanager
     • Type: alertmanager
  8. Name: grafanacloud-mcpreviewer-profiles
     • UID: grafanacloud-profiles
     • Type: grafana-pyroscope-datasource
  9. Name: grafanacloud-mcpreviewer-prom
     • UID: grafanacloud-prom
     • Type: prometheus (Default)
  10. Name: grafanacloud-mcpreviewer-traces
      • UID: grafanacloud-traces
      • Type: tempo
  11. Name: grafanacloud-mcpreviewer-usage-insights
      • UID: grafanacloud-usage-insights
      • Type: loki
  12. Name: grafanacloud-ml-metrics
      • UID: grafanacloud-ml-metrics
      • Type: prometheus
  13. Name: grafanacloud-usage
      • UID: grafanacloud-usage
      • Type: prometheus These datasources can be utilized for various metrics and log retrieval operations within the Grafana platform.
• Test case 3

  Score: 9/10

  Perform the operation of listing all OnCall schedules in the Grafana instance, including their IDs, names, associated team IDs, time zones, and shift IDs.

  There are currently no OnCall schedules available in the Grafana instance.

• Test case 4

  Score: 10/10

  Perform the operation of retrieving the list of all alert rules configured in the Grafana instance, including their unique IDs, names, and current statuses.

  There are currently no alert rules configured in the Grafana instance.

• Test case 5

  Score: 8/10

  Perform the operation of retrieving the list of all Sift investigations in the Grafana instance, including their unique IDs, titles, and creation timestamps.

  The following Sift investigations were retrieved:

  1. Investigation ID: 944f1427-cc6e-4060-89f3-db632d18dd20
     • Title: Slow Request Investigation
     • Created: 2025-07-25T01:45:20.759Z
  2. Investigation ID: 4d465657-44b9-4a87-b81a-e76314c58004
     • Title: Slow Request Investigation
     • Created: 2025-07-25T01:45:13.693Z
  3. Investigation ID: 009ccd44-4042-4ffa-8798-23da7749759d
     • Title: Error Pattern Investigation
     • Created: 2025-07-25T01:45:05.168Z
  4. Investigation ID: 010f3676-ca4e-4a5e-a3dd-3f8c8b81c90e
     • Title: Error Pattern Investigation
     • Created: 2025-07-25T01:44:57.68Z
  5. Investigation ID: b9792826-6a67-47ef-b0bb-0ff9b0559ed9
     • Title: Error Pattern Investigation
     • Created: 2025-07-25T01:44:50.064Z
  6. Investigation ID: 3411d728-19a2-4d5a-a7b2-825dc596c4b9
     • Title: Investigate Slow Requests
     • Created: 2025-07-24T09:17:28.943Z
  7. Investigation ID: ba8ed64d-fa94-4c33-ac3d-65a112ce345f
     • Title: Investigate Slow Requests
     • Created: 2025-07-24T09:17:20.526Z
  8. Investigation ID: 863ae499-2663-4949-b239-28cbdcc4e35e
     • Title: Error Pattern Analysis
     • Created: 2025-07-24T09:17:09.146Z
  9. Investigation ID: 050fdf1d-b862-4310-ad37-779d68db34b9
     • Title: Error Pattern Analysis
     • Created: 2025-07-24T09:17:00.168Z
  10. Investigation ID: 505e91f2-3eec-4b27-a2eb-42dcdf2d3cfb
      • Title: Error Pattern Analysis
      • Created: 2025-07-24T09:16:43.223Z All investigations failed due to the absence of the required datasources. Please ensure that the datasources are configured properly and that the necessary labels exist in the datasources.