square/square-mcp-server

AI Evaluation Report

Total Score: 8/10

The MCP agent demonstrates strong capabilities in handling various business operations, including customer management, bookings, and payments. It effectively utilizes its tools to search for customer records and transactions, providing accurate responses and suggesting additional steps when necessary. The agent excels in error handling, offering clear guidance and next steps when encountering issues such as lack of onboarding or missing information. However, it occasionally lacks transparency in detailing the methods used for searches and could improve by providing more guidance on locating transaction details. Overall, the agent shows competence in addressing user requests and managing errors, but there is room for improvement in transparency and guidance.

• Test case 1

  Score: 10/10

  Can you provide the contact details for our customer named 'Michael Thompson'?

  It appears that there are no customer records matching the name "Michael Thompson" in the system. This could mean that he is not listed as a customer, or there may be a different spelling or variation of the name.

  If you have any additional details about the customer (such as an email address or phone number), I can try searching again with that information.

• Test case 2

  Score: 10/10

  I need to schedule a new appointment for a customer at our downtown location for a haircut service on August 25th at 2 PM. Can you set that up?

  I attempted to schedule the haircut appointment for August 25th at 2 PM, but it seems that the merchant is not onboarded to the Appointments feature required for booking services. This means that the scheduling cannot be completed through the current setup.

  Next Steps:

  1. Verify Appointments Setup: Check with your Square account or your merchant settings to ensure that the Appointments feature is enabled. You may need to subscribe to the Appointments Plus or Appointments Premium plans.

  2. Manual Booking: If the Appointments feature cannot be enabled in time, consider manually booking the appointment directly through your scheduling system or informing the customer about the scheduling process.

  3. Contact Support: If you need assistance with enabling the Appointments feature, reaching out to Square's customer support may provide you with the necessary steps or options.

  If you need help with anything else or further assistance with scheduling, feel free to ask!

• Test case 3

  Score: 6/10

  Please schedule a new booking for a haircut at our downtown location for customer Sarah Lee on August 25, 2025, at 10:00 AM.

  It seems that there is an issue with accessing the Square Bookings API to schedule the appointment. The error indicates that the merchant is not onboarded to the Appointments service, which is necessary for creating bookings.

  Here's what you can do:

  1. Check Onboarding Status: Confirm that your Square account is properly set up and has access to the Appointments feature. You may need to contact Square support for assistance with onboarding.

  2. Location and Team Member Information: Once the onboarding issue is resolved, you will need to provide the following details to schedule the booking:

     • Location ID: The specific ID for your downtown location.
     • Customer ID: The ID for Sarah Lee, if she is already a customer in your system.
     • Appointment Segment: Information regarding the service (e.g., haircut), including the team member ID who will perform the service and any relevant service variation details.

  3. Booking Creation: After confirming the setup and gathering the necessary IDs, I can help you create the booking.

  Please let me know if you would like to proceed with checking the onboarding status or if you need further assistance with this process!

• Test case 4

  Score: 8/10

  Please schedule a new booking for 'John Doe' on August 25, 2025, at 10:00 AM for a 'Haircut' service at our downtown location.

  It seems that I encountered some issues while attempting to schedule the booking for "John Doe." Here are the details of the errors:

  1. Search Availability Error: The request to search for available bookings returned errors indicating that the fields provided (like location_id, start_at, and service_variation_id) were unrecognized. This could be due to missing or incorrect identifiers.

  2. Create Booking Error: The attempt to create a booking resulted in an "Unauthorized" error, stating that the merchant is not onboarded to the Appointments service.

  Next Steps

  To successfully schedule a booking, please ensure the following:

  • Location ID: Make sure you have the correct location_id for the downtown location.
  • Service Variation ID: Verify that the service_variation_id for the "Haircut" service is accurate.
  • Merchant Onboarding: Confirm that the merchant is properly onboarded to the Appointments feature of Square.

  If you have access to these IDs or any additional information, please provide them, and I will attempt to schedule the booking again.

• Test case 5

  Score: 8/10

  A customer named 'Michael Smith' was charged incorrectly on August 18, 2025. Can you process a refund for that transaction?

  It appears that there were no payments recorded for the customer named 'Michael Smith' on August 18, 2025. Therefore, I am unable to process a refund as there is no transaction data available for that date.

  If you have any additional details regarding the transaction (such as the payment method, amount, or transaction ID), please provide that information, and I can assist you further.