weatherapi-com
weatherapi-com is hosted online, so all tools can be tested directly either in theInspector tabor in theOnline Client.
If you are the rightful owner of weatherapi-com and would like to certify it and/or have it hosted online, please leave a comment on the right or send an email to henry@mcphub.com.
WeatherAPI.com MCP Server provides tools for accessing weather and geolocation data.
Test Report
- Build Successful
- Server Started
- Client Connected
- Tools Listed
- All Tools Succeeded
- Any Tool Succeeded
Tool | Total Tests | Success | Fail | Success Rate |
---|---|---|---|---|
sports_api | 1 | 0 | 1 | 0% |
iplookup_api | 1 | 1 | 0 | 100% |
time_zone_api | 1 | 1 | 0 | 100% |
astronomy_api | 1 | 0 | 1 | 0% |
search_autocomplete_api | 1 | 1 | 0 | 100% |
forecast_weather_api | 1 | 1 | 0 | 100% |
realtime_weather_api | 1 | 1 | 0 | 100% |
future_weather_api | 1 | 0 | 1 | 0% |
history_weather_api | 1 | 0 | 1 | 0% |
marine_weather_api | 1 | 0 | 1 | 0% |
EvaluationTotal Score: 7/10
Evaluation Summary
- The agent demonstrates a strong ability to provide detailed and comprehensive weather and location-based information, aligning well with its stated capabilities. Here are the key strengths and weaknesses observed:
- Strengths:
-
- Completeness and Clarity: The agent consistently provides thorough and well-organized responses, covering multiple parameters relevant to the queries, such as weather conditions, time zone information, and astronomy details.
-
- Consistency with Claimed Capabilities: The agent effectively delivers on its promised capabilities, such as current weather, weather forecasts, time zone information, and astronomy data.
-
- Proactive Assistance: The agent offers to provide additional information or assistance when data is not immediately available, demonstrating a willingness to help further.
- Weaknesses:
-
- Data Accuracy: There are discrepancies in the weather data provided, such as unusually high temperatures and outdated or incorrect event information, which suggest potential issues with data sourcing or timeliness.
-
- Encoding Issues: The presence of encoding errors (e.g., 'Â' characters) in temperature values detracts from the readability and professionalism of the responses.
-
- Lack of Source Attribution: The agent does not consistently cite sources for its data, which could enhance credibility and allow users to verify the information.
- Suggestions for Improvement:
-
- Improve Data Accuracy: Ensure access to reliable and up-to-date data sources to maintain the accuracy of weather and event information.
-
- Address Encoding Issues: Resolve character encoding problems to prevent display errors.
-
- Include Source Attribution: Provide source information for data to enhance transparency and trustworthiness.
- Overall, the agent performs well in delivering comprehensive and clear information but needs improvements in data accuracy and presentation to achieve higher quality.
- Final Score: 7
Test case 1
Score: 7/10What is the current weather in Tokyo, Japan?The current weather in Tokyo, Japan is as follows:
- Temperature: 33.3°C (91.9°F)
- Condition: Partly cloudy
- Humidity: 49%
- Wind: 20.8 mph (33.5 kph) from the South-Southwest (SSW)
- Pressure: 1005 mb (29.68 in)
- Visibility: 10 km (6 miles)
- Feels Like: 35.5°C (95.9°F)
Overall, it feels quite warm and partly cloudy in Tokyo right now. If you need more information, feel free to ask!
Completeness: The response covers multiple weather parameters, offering a thorough snapshot of the current conditions.
Clarity: The information is well-organized and easy to understand, with both metric and imperial units provided.
Consistency with Claimed Capabilities: The agent effectively delivers current weather information, aligning with its stated capabilities.
Accuracy/Correctness: The temperature is reported as 33.3°C (91.9°F), but the 'Â' character indicates a potential encoding issue. Additionally, the temperature seems higher than other sources. For instance, The Weather Network reports a current temperature of 27°C (80.6°F) (theweathernetwork.com), and MSN Weather reports 69°F (20.6°C) (msn.com). This discrepancy suggests the agent's data may be outdated or sourced differently.
Test case 2
Score: 6/10Can you provide a 7-day weather forecast for Paris, France?Here's a 7-day weather forecast for Paris, France:
7-Day Weather Forecast for Paris
Day 1: June 22, 2025
- Condition: Sunny
- Max Temp: 31.5°C (88.7°F)
- Min Temp: 20.6°C (69.2°F)
- Humidity: 44%
- Wind: 13.7 kph (8.5 mph) W
- Chance of Rain: 0%
Day 2: June 23, 2025
- Condition: Sunny
- Max Temp: 27.0°C (80.6°F)
- Min Temp: 15.9°C (60.6°F)
- Humidity: 52%
- Wind: 23.8 kph (14.8 mph) N
- Chance of Rain: 0%
Day 3: June 24, 2025
- Condition: Sunny
- Max Temp: 31.2°C (88.1°F)
- Min Temp: 12.7°C (54.8°F)
- Humidity: 48%
- Wind: 15.5 kph (9.6 mph) N
- Chance of Rain: 0%
Day 4: June 25, 2025
- Condition: Patchy rain nearby
- Max Temp: 35.3°C (95.5°F)
- Min Temp: 18.2°C (64.7°F)
- Humidity: 56%
- Wind: 16.9 kph (10.5 mph) N
- Chance of Rain: 77%
Day 5: June 26, 2025
- Condition: Moderate rain
- Max Temp: 22.5°C (72.6°F)
- Min Temp: 17.1°C (62.7°F)
- Humidity: 88%
- Wind: 20.5 kph (12.8 mph) N
- Chance of Rain: 88%
Day 6: June 27, 2025
- Condition: Sunny
- Max Temp: 27.3°C (81.1°F)
- Min Temp: 15.2°C (59.4°F)
- Humidity: 62%
- Wind: 11.2 kph (6.9 mph) NW
- Chance of Rain: 0%
Day 7: June 28, 2025
- Condition: Sunny
- Max Temp: 30.9°C (87.7°F)
- Min Temp: 17.9°C (64.2°F)
- Humidity: 51%
- Wind: 13.3 kph (8.3 mph) NW
- Chance of Rain: 0%
Feel free to ask if you need more information or details!
Completeness: The forecast covers multiple weather parameters for each day, offering a comprehensive overview.
Clarity: The information is well-organized and easy to understand, with both metric and imperial units provided.
Consistency with Claimed Capabilities: The agent effectively delivers a 7-day weather forecast, aligning with its stated capabilities.
Encoding Issues: The temperature values contain 'Â' characters, indicating a potential encoding problem.
Data Accuracy: The forecasted temperatures are significantly higher than historical averages for Paris in June. For instance, the average high temperature in June is around 21°C (70°F), with average lows around 12°C (54°F) source. The provided forecast predicts highs up to 35.3°C (95.5°F), which is unusually high for Paris in June.
Test case 3
Score: 3/10What are the upcoming major football events and their dates?It seems that there are currently no upcoming major football events listed in the available data. This might be due to a lack of scheduled events at this time or an issue with the data source. If you have a specific league or tournament in mind, please let me know, and I can try to find more information for you!
Transparency: The agent openly acknowledges the potential limitations of its data source.
Proactive Assistance: Offers to find more information if the user specifies a particular league or tournament.
Accuracy/Correctness: The statement about the absence of upcoming major football events is incorrect. Several significant football events are scheduled for 2025, including:
FIFA Club World Cup: Scheduled from June 15 to July 13, 2025, in the United States. This expanded tournament features 32 clubs from around the world. Source
UEFA Women's Euro 2025: Set to take place from July 2 to 27, 2025, in Switzerland, featuring Europe's top women's national teams. Source
UEFA Super Cup: Scheduled for August 13, 2025, at Stadio Friuli in Udine, Italy, between Paris Saint-Germain and Tottenham Hotspur. Source
FIFA U-20 World Cup: To be held from September 27 to October 19, 2025, in Chile, showcasing the world's best under-20 national teams. Source
Test case 4
Score: 9/10Can you provide the current time and time zone information for Sydney, Australia?The current time in Sydney, Australia is 2:25 PM on June 22, 2025. The time zone is Australia/Sydney. If you need any further details, feel free to ask!
Accuracy/Correctness: The reported time of 2:25 PM on June 22, 2025, is accurate, considering the user's current time of 4:25 AM on the same date in the United States. This aligns with the 14-hour time difference between Sydney (AEST, UTC+10) and Eastern Daylight Time (EDT, UTC-4) in the U.S. during this period.
Completeness: The response includes both the current time and the time zone (Australia/Sydney), providing a clear understanding of Sydney's local time context.
Consistency with Claimed Capabilities: The agent effectively delivers time zone information, aligning with its stated capabilities.
Usefulness / Clarity: The information is presented concisely and clearly, making it easy for the user to understand.
Lack of Daylight Saving Time Context: While the response mentions the time zone as "Australia/Sydney," it does not specify that Sydney is currently observing Australian Eastern Standard Time (AEST, UTC+10) and that daylight saving time (Australian Eastern Daylight Time, AEDT, UTC+11) ended on April 6, 2025, and will resume on October 5, 2025. Including this context would enhance the completeness of the information. Source
Test case 5
Score: 9/10Can you provide the sunrise and sunset times for New York City on July 4, 2025?On July 4, 2025, the sunrise and sunset times for New York City are as follows:
- Sunrise: 5:31 AM
- Sunset: 8:30 PM
If you have any other questions or need further information, feel free to ask!
Accuracy/Correctness: The provided sunrise time of 5:31 AM aligns with data from multiple sources. For instance, SunriseSunset.com lists the sunrise at 5:30 AM and sunset at 8:31 PM on July 4, 2025. (sunrisesunset.com) Another source, Sunrise and Sunset, reports sunrise at 5:31 AM and sunset at 8:29 PM. (sunrise-and-sunset.com) These slight variations are typical due to differences in calculation methods and geographic coordinates used.
Completeness: The response includes both sunrise and sunset times, providing a complete answer to the user's query.
Consistency with Claimed Capabilities: The agent effectively delivers astronomy information, aligning with its stated capabilities.
Usefulness / Clarity: The information is presented concisely and clearly, making it easy for the user to understand.
Lack of Source Attribution: The response does not cite the sources of the sunrise and sunset times. Providing source information would enhance the credibility and allow users to verify the data.