openbnb-org/mcp-server-airbnb

AI Evaluation Report

Total Score: 7/10

The agent demonstrates a strong ability to search for Airbnb listings based on specified criteria, providing detailed information including price, location, and amenities. However, it occasionally fails to adhere strictly to the specified price range and location criteria. The agent also retrieves detailed information about specific listings but sometimes lacks specific details on guest accommodations and booking dates. Additionally, there was a tool malfunction during one of the searches, indicating a limitation in reliability. Overall, the agent is effective but has room for improvement in accuracy and reliability.

• Test case 1

  Score: 10/10

  Search for Airbnb listings in Paris with check-in on August 15, 2025, check-out on August 20, 2025, for 2 adults and 1 child, priced between $100 and $200 per night.

  I found several Airbnb listings in Paris for your specified dates (check-in on August 15, 2025, and check-out on August 20, 2025) for 2 adults and 1 child, priced between $100 and $200 per night.

  Here are some options:

  1. Charming apartment Butte Montmartre / Martyrs
     • Price: ~$184.16 per night (total ~$920 for 5 nights)
     • Rating: 4.98 out of 5 (58 reviews)
     • Description: 2 beds, 1 bedroom
     • Location: Montmartre area
     • Badges: Guest favorite
  2. Charming & calme apt, Eiffel Tower view
     • Price: ~$187.05 per night (total ~$935 for 5 nights)
     • Rating: 4.98 out of 5 (61 reviews)
     • Description: 1 bed, 1 bedroom
     • Location: Near the Eiffel Tower
     • Badges: Guest favorite
  3. Cozy nest with rooftop views
     • Price: ~$164.66 per night (total ~$823 for 5 nights)
     • Rating: 4.97 out of 5 (29 reviews)
     • Description: 2 beds, 1 bedroom
     • Location: Central Paris
     • Badges: Guest favorite
  4. Sauna, Gym & Luxurious and Elegant 2-Room
     • Price: ~$104.73 per night (total ~$523 for 5 nights)
     • Rating: 5.0 out of 5 (3 reviews)
     • Description: 2 beds, 1 bedroom
     • Location: Elegant neighborhood
     • Badges: Superhost
  5. Très bel appartement au coeur de Paris
     • Price: ~$184.41 per night (total ~$922 for 5 nights)
     • Rating: 4.83 out of 5 (109 reviews)
     • Description: 2 beds, 1 bedroom
     • Location: Heart of Paris
     • Badges: Guest favorite For further details on more listings, please visit this link. Let me know if you need any more help!
• Test case 2

  Score: 6/10

  Retrieve detailed information about the Airbnb listing with ID 50655509, including the number of guests it accommodates (adults, children, infants, pets) and its booking dates.

  • Listing URL: Airbnb Listing
  • Location: Paris, Île-de-France, France
  • Accommodation Details:
    • Type: One-bedroom apartment
    • Maximum Guests: 3 guests (including adults and children)
    • Pets: Allowed
    • Infants: Not specified but typically allowed (check with host)
  • Booking Dates: Check-in after 3:00 PM, Checkout before 10:00 AM
  • House Rules:
    • Self check-in with lockbox
    • No parties or events
    • Smoking is allowed
  • Description: This apartment is described as comfortable with a living room that includes a convertible couch and a sunny balcony. Located near the lively Rue des Martyrs, it is in a calm area with easy access to public transport.
  • Amenities:
    • Scenic views of a courtyard
    • Free washer and dryer in the unit
    • Wi-Fi and a dedicated workspace
    • Kitchen with essential cooking appliances
    • Outdoor furniture on a private patio or balcony This listing provides a cozy atmosphere with a friendly neighborhood feel, perfect for travelers looking to explore Paris.
• Test case 3

  Score: 2/10

  Search for Airbnb listings in Tokyo with check-in on September 10, 2025, check-out on September 15, 2025, for 1 adult, priced between $50 and $150 per night.

  Tool malfunction: Failure due to tool malfunction.

• Test case 4

  Score: 6/10

  Search for Airbnb listings in New York City with check-in on October 5, 2025, check-out on October 10, 2025, for 2 adults and 2 children, priced between $150 and $300 per night.

  I found several Airbnb listings in New York City for your specified dates and requirements. Here are some options within the price range of $150 to $300 per night:

  1. Jazz Nights, City Views + Brunch on Site
     • Price: Approximately $328.15 per night
     • Total for 5 nights: $1,475.13 after discounts
     • Location: 10 min drive from main attractions
     • Rating: New place to stay
  2. Gorgeous, 2 Bedroom walking distance to GWB!
     • Price: Approximately $263.38 per night
     • Total for 5 nights: $1,316.92
     • Location: 10 min drive from main attractions
     • Rating: 4.9 out of 5 (154 reviews) - Guest favorite
  3. Fresh 2Bed Gem-15min to NYC-3min Walk to Bus/Train
     • Price: Approximately $248.32 per night
     • Total for 5 nights: $1,241.60
     • Location: 30 min drive from NYC
     • Rating: 5.0 out of 5 (25 reviews) - Guest favorite
  4. Bedford Luxuria, apt close to NYC & airport
     • Price: Approximately $191.63 per night
     • Total for 5 nights: $958.13
     • Location: 20 min drive from NYC
     • Rating: 4.87 out of 5 (47 reviews) - Guest favorite
  5. Cozy & Chic Private Room-20 mins to Manhattan
     • Price: Approximately $196.28 per night
     • Total for 5 nights: $981.41
     • Location: 30 min drive from Manhattan
     • Rating: New place to stay - Superhost For more options, you can click here to view the complete search results.
• Test case 5

  Score: 5/10

  Retrieve detailed information about the Airbnb listing with ID 1442237655047880641, including the number of guests it accommodates (adults, children, infants, pets) and its booking dates.

  Airbnb Listing Details

  • Listing URL: Renaissance New York Harlem Hotel

  Guest Accommodation

  • Maximum Guests: 4
  • Bed Configuration: Two Queen beds
  • Children: Not specified separately; total guests (adults + children + infants) must not exceed 4.
  • Infants: Not specified (typically counts as part of total guests).
  • Pets: No pets allowed.

  Booking Information

  • Check-in Time: From 4:00 PM
  • Checkout Time: By 12:00 PM

  Important Policies

  • House Rules:
    • Maximum of 4 guests.
    • No pets, parties, or events allowed.
    • No smoking on the property.