mendableai/firecrawl-mcp-server

AI Evaluation Report

Total Score: 5/10

The agent demonstrates a mixed performance in executing web scraping tasks. It successfully retrieves specific data, such as current weather conditions, indicating its capability to extract structured information accurately. However, it struggles with providing up-to-date articles from news websites, often returning outdated or incomplete information. Additionally, the agent encounters tool malfunctions, as seen in the attempt to generate an llms.txt file for 'nytimes.com'. Overall, while the agent shows potential in certain areas, its limitations in maintaining data accuracy and handling specific requests reduce its overall effectiveness.

• Test case 1

  Score: 2/10

  Perform the operation of extracting the latest five articles from the 'Technology' section of the BBC News website, including their titles, publication dates, and summaries.

  Latest Articles from the Technology Section of BBC News

  1. What screen time does to children's brains is more complicated than it seems
     • Published: 2 hrs ago
     • Summary: Screen time has become synonymous with bad news - but the science may not be as straightforward as it seems. Read more
  2. 2,500-year-old Siberian 'ice mummy' had intricate tattoos, imaging reveals
     • Published: 2 hrs ago
     • Summary: The woman, aged about 50, was buried in a Siberian ice cave and discovered millennia later. Read more
  3. Dating safety app Tea suspends messaging after hack
     • Published: 16 hrs ago
     • Summary: This comes after a hack that exposed thousands of members' images, posts, and comments. Read more
  4. UK gets first female Astronomer Royal in 350 years
     • Published: 1 day ago
     • Summary: Prof Michele Dougherty is the first woman to be appointed to the influential post. Read more
  5. Why plane turbulence is becoming more frequent - and more severe
     • Published: 1 day ago
     • Summary: Flights are getting bumpier, partly due to climate change. New studies are looking into innovative potential ways to turbulence-proof wings. Read more
• Test case 2

  Score: 2/10

  Perform the operation of generating an llms.txt file for the domain 'nytimes.com' to define how large language models should interact with the site.

  Tool malfunction: The request to generate an llms.txt file for the domain 'nytimes.com' failed with a status code 403, indicating that the website is no longer supported by the tool.

• Test case 3

  Score: 9/10

  Perform the operation of extracting the current weather conditions, including temperature, humidity, and wind speed, for New York City from the National Weather Service website.

  The current weather conditions for New York City are as follows:

  • Temperature: 76°F (24°C)
  • Humidity: 91%
  • Wind Speed: Calm
  • Condition: Fog/Mist This data was last updated on July 30, 2025, at 8:51 PM EDT.
• Test case 4

  Score: 5/10

  Perform the operation of extracting the latest five articles from the 'Science' section of the CNN website, including their titles, publication dates, and summaries.

  Latest Articles from CNN's Science Section

  1. Record-breaking prime number containing more than 41 million digits found by former Nvidia programmer
     • Published Date: November 1, 2024
     • Summary: A former Nvidia programmer, Luke Durant, discovered the world's largest known prime number, M136279841, which consists of 41,024,320 digits. This discovery is significant as it marks the first prime breakthrough in nearly six years.
  2. Lost underwater forests are returning to Sydney’s coastline
     • Published Date: June 27, 2025
     • Summary: The conservation initiative, Operation Crayweed, aims to restore the golden-brown seaweed, crayweed, which has disappeared from Sydney's coastline since the 1980s. The project has successfully established self-sustaining populations across various sites.
  3. This company wants to reinvent the space rocket — as a space plane
     • Published Date: September 2, 2024
     • Summary: Radian Aerospace is designing the Radian One, a space plane capable of reaching orbit in a single stage. This innovative approach aims to reduce costs and enhance the efficiency of space exploration.
  4. Meet the veteran astronauts riding aboard Starliner’s historic first crewed launch Saturday
     • Published Date: May 31, 2024
     • Summary: NASA's Boeing Starliner is set for its inaugural crewed launch, carrying experienced astronauts Butch Wilmore and Suni Williams to the International Space Station. The launch is highly anticipated after previous delays.
  5. To tackle the e-waste problem, this casing for electronics dissolves in water
     • Published Date: April 7, 2025
     • Summary: A new type of plastic casing, Aquafade, dissolves in water in about six hours, offering a potential solution to the growing e-waste crisis. This innovation aims to simplify the recycling process for electronic devices.
• Test case 5

  Score: 3/10

  Perform the operation of extracting the latest five articles from the 'Health' section of the Reuters website, including their titles, publication dates, and summaries.

  Latest Health Articles from Reuters

  1. Title: US health officials, tech executives to launch data-sharing plan, Bloomberg News reports
     • Publication Date: July 26, 2025
     • Summary: Top Trump administration health officials are expected to bring tech companies to the White House this week to roll out a plan to encourage more seamless sharing of health-care data, Bloomberg News reported on Saturday.
  2. Title: US FDA's top vaccine official Vinay Prasad leaves agency after 3 months
     • Publication Date: July 30, 2025
     • Summary: The U.S. Food and Drug Administration's top vaccine official, Vinay Prasad, has left the agency after just three months as Director of the Center for Biologics Evaluation and Research, following criticism of regulatory decisions.
  3. Title: Wegovy maker Novo's profit warning triggers $70 billion share rout
     • Publication Date: July 29, 2025
     • Summary: Investors wiped $70 billion off Novo Nordisk's market value after the maker of weight-loss drug Wegovy issued a profit warning and named a new CEO, as it battles rising competition in the obesity drug market.
  4. Title: What other health conditions are weight loss drugs being tested for?
     • Publication Date: February 6, 2024
     • Summary: Eli Lilly's blockbuster diabetes drug Mounjaro and weight-loss therapy Zepbound, as well as Novo Nordisk's rival medicines Ozempic and Wegovy are being studied to see whether they can improve health in other ways.
  5. Title: FDA recommends 7-OH compound found in vapes be controlled
     • Publication Date: July 29, 2025
     • Summary: The U.S. Food and Drug Administration is recommending the scheduling of the 7-OH compound as a controlled substance because of its opioid properties, FDA Commissioner Marty Makary said on Tuesday.