awkoy/notion-mcp-server

AI Evaluation Report

Total Score: 3/10

The agent consistently failed to perform the task of creating a new Notion database with specified properties due to input validation errors. This indicates a significant limitation in handling the input format or understanding the schema requirements for database creation in Notion. The agent's inability to provide valid answers or guidance on correcting the input format further highlights its weakness in this area. Despite having a broad range of operations it claims to support, the agent's performance in this specific task was inadequate, suggesting a need for improvement in handling complex input structures and providing more informative error messages or solutions.

• Test case 1

  Score: 6/10

  Perform the operation of creating a new Notion database titled 'Project Tracker' under the page with ID '98ad959b-2b6a-4774-80ee-00246fb0ea9b'. The database should have the following properties: 'Project Name' (title), 'Status' (select with options 'Not Started', 'In Progress', 'Completed'), 'Due Date' (date), and 'Priority' (select with options 'Low', 'Medium', 'High').

  No valid answer is generated due to invalid input. The attempts to create the 'Project Tracker' database encountered input validation errors. The parameters for the database properties may need to be revised for compliance with the expected schema. Specifically, the properties for 'Status', 'Due Date', and 'Priority' are being flagged as not conforming to the expected schema. It is recommended to review the API documentation or schema requirements for creating a database in Notion to ensure compliance with the necessary parameters.

• Test case 2

  Score: 6/10

  Perform the operation of creating a new Notion database titled 'Event Planner' under the page with ID '98ad959b-2b6a-4774-80ee-00246fb0ea9b'. The database should have the following properties: 'Event Name' (title), 'Date' (date), 'Location' (rich_text), and 'Attendees' (multi_select with options 'Family', 'Friends', 'Colleagues', 'Others').

  No valid answer is generated due to invalid input. The creation of the database titled 'Event Planner' failed due to input validation errors. The properties for the database need to be structured correctly according to the Notion API's requirements, which may involve ensuring that each property type has the correct attributes and structure. It is recommended to review the Notion API documentation for the exact specifications on how to define properties for a database.

• Test case 3

  Score: 6/10

  Perform the operation of creating a new Notion database titled 'Book Collection' under the page with ID '98ad959b-2b6a-4774-80ee-00246fb0ea9b'. The database should have the following properties: 'Title' (title), 'Author' (rich_text), 'Genre' (select with options 'Fiction', 'Non-Fiction', 'Science Fiction', 'Biography', 'Mystery', 'Fantasy'), 'Publication Date' (date), and 'Rating' (number).

  No valid answer is generated due to invalid input. The attempt to create the 'Book Collection' database failed due to an input validation error. The property definitions may not have been formatted correctly. The properties should be structured according to Notion's API requirements. Please ensure that the properties are defined with the correct types and structures before trying again.

• Test case 4

  Score: 6/10

  Perform the operation of creating a new Notion database titled 'Travel Itinerary' under the page with ID '98ad959b-2b6a-4774-80ee-00246fb0ea9b'. The database should have the following properties: 'Destination' (title), 'Departure Date' (date), 'Return Date' (date), 'Accommodation' (rich_text), and 'Activities' (multi_select with options 'Sightseeing', 'Hiking', 'Beach', 'Museum', 'Shopping').

  No valid answer is generated due to invalid input. The attempt to create the database titled 'Travel Itinerary' failed due to input validation errors. It seems that the structure of the properties provided for the database does not match the required schema. To resolve this, the input format for the properties needs to be adjusted.

• Test case 5

  Score: 6/10

  Perform the operation of creating a new Notion database titled 'Task Manager' under the page with ID '98ad959b-2b6a-4774-80ee-00246fb0ea9b'. The database should have the following properties: 'Task Name' (title), 'Description' (rich_text), 'Due Date' (date), 'Status' (select with options 'To Do', 'In Progress', 'Done'), and 'Priority' (select with options 'Low', 'Medium', 'High').

  No valid answer is generated due to invalid input. The attempts to create the 'Task Manager' database failed due to input validation errors. The provided parameters for the database creation do not conform to the expected schema set by Notion's API. The properties should be structured properly, including ensuring that each property type is accurately specified. Consistent issues with the input format were encountered.