aigeon-ai/yotpo

AI Evaluation Report

Total Score: 5/10

The agent demonstrates the ability to provide information on product reviews and ratings using the Yotpo API. However, there are several areas for improvement. The agent often provides outdated review data from 2012, which is not relevant for the current year, 2025. Additionally, the reviews sometimes contain generic or placeholder text, reducing their usefulness. The agent also fails to verify the accuracy of the data provided, such as average ratings and total reviews, due to a lack of real-time API access. Furthermore, the agent encountered an error when attempting to retrieve products with an invalid application key, but it correctly identified the issue as a permissions problem. Overall, while the agent can retrieve and present data, it struggles with ensuring the relevance and accuracy of the information.

• Test case 1

  Score: 5/10

  Retrieve the bottom line score (average rating and total number of reviews) for the product with ID '12345' using the Yotpo API.

  Average Rating: 4.3, Total Number of Reviews: 56

• Test case 2

  Score: 4/10

  Retrieve all reviews for the product with ID '67890' using the Yotpo API.

  The product with ID '67890' has a total of 56 reviews. Below are some highlights from the reviews:

  1. Review ID: 2393
     • Title: test
     • Content: test
     • Score: 5
     • User: simer.plaha
     • Created At: 2012-11-11
     • Product URL: Amazing Yotpo poster
  2. Review ID: 2392
     • Title: test review
     • Content: test review
     • Score: 5
     • User: simer.plaha
     • Created At: 2012-11-11
     • Product URL: Amazing Yotpo poster
  3. Review ID: 2171
     • Title: Trial1
     • Content: Trial1
     • Score: 5
     • User: עמרי כ.
     • Created At: 2012-10-29
     • Product URL: Amazing Yotpo poster
  4. Review ID: 2170
     • Title: Trial Review
     • Content: Trial Review
     • Score: 5
     • User: עמרי כ.
     • Created At: 2012-10-29
     • Product URL: Amazing Yotpo poster
  5. Review ID: 1857
     • Title: Amazing poster
     • Content: bla bla bla
     • Score: 5
     • User: Tomer Tagrin
     • Created At: 2012-10-09
     • Product URL: Amazing Yotpo poster These reviews highlight positive experiences with the product, emphasizing satisfaction with both the product quality and the purchasing experience.
• Test case 3

  Score: 6/10

  Retrieve a list of all products associated with the application key 'abc123' using the Yotpo API.

  No valid answer is generated due to invalid input. The request to retrieve products associated with the application key 'abc123' resulted in a 'Forbidden' error, indicating that access is not permitted. This could be due to the application key being invalid or insufficient permissions associated with the key. Please verify the application key and permissions before trying again.

• Test case 4

  Score: 5/10

  Retrieve the top three 5-star reviews for the product with ID '98765' using the Yotpo API.

  I retrieved the top three 5-star reviews for the product with ID '98765'. Here they are:

  1. Title: Test
     • Content: test
     • Score: 5 stars
     • User: simer.plaha
     • Created At: November 11, 2012
     • Product Link: Amazing Yotpo poster
  2. Title: Test Review
     • Content: test review
     • Score: 5 stars
     • User: simer.plaha
     • Created At: November 11, 2012
     • Product Link: Amazing Yotpo poster
  3. Title: Trial1
     • Content: Trial1
     • Score: 5 stars
     • User: עמרי כ. (Omri Cohen)
     • Created At: October 29, 2012
     • Product Link: Amazing Yotpo poster
• Test case 5

  Score: 8/10

  Retrieve the bottom line score (average rating and total number of reviews) for the product with SKU 'ABC123' using the Yotpo API.

  The bottom line score for the product with SKU 'ABC123' is as follows:

  • Average Rating: 4.3
  • Total Number of Reviews: 56