linkedin-data-api

Evaluation

Total Score: 3/10

Evaluation Summary

• Strengths:
• 1. Clarity and Structure: The agent consistently provides well-organized responses with clear headings and structured information.
• 2. Use of Hyperlinks: Responses often include direct links to content, allowing users to verify and explore further.
• Weaknesses:
• 1. Accuracy/Correctness: The agent frequently provides inaccurate or fabricated information, particularly when retrieving LinkedIn profiles or recent activities of high-profile individuals.
• 2. Completeness: Many responses lack the requested details, such as specific skills or experience, and fail to fulfill the user's requests comprehensively.
• 3. Consistency with Claimed Capabilities: Despite claiming the ability to retrieve detailed LinkedIn data, the agent often fails to deliver accurate or complete information.
• 4. Usefulness / Clarity: Misleading or fabricated information reduces the usefulness and trustworthiness of the responses.
• Suggestions for Improvement:
• • Verify Information: Implement mechanisms to ensure the accuracy of retrieved data and avoid fabricating content.
• • Acknowledge Limitations: Clearly communicate any limitations in data access or availability to the user.
• • Provide Alternative Solutions: Offer related information or suggest alternative methods for obtaining the requested data when direct access is unavailable.
• Overall, while the agent demonstrates good organizational skills, its frequent inaccuracies and fabricated content significantly undermine its reliability and effectiveness.

• Test case 1

  Score: 3/10

  Can you retrieve the LinkedIn profile information for Elon Musk, including his experience and skills?

  I found the LinkedIn profile information for Elon Musk. Here are the details:

  • Name: Elon Musk
  • Headline: Attended University of Lima
  • Location: Lima Metropolitan Area, Peru
  • Profile URL: Elon Musk LinkedIn Profile

  Education:

  • University: University of Lima
    • Field of Study: Not specified
    • Degree: Not specified
    • Start Year: 2024
    • School URL: University of Lima

  Skills and Experience:

  • The detailed skills and experience sections are not available in the data retrieved.

  If you need more specific information or details on skills, let me know!

  1. Clarity: The response is well-structured, presenting information in a clear and organized manner.

  1. Incorrect Profile Information: The response provides details for an individual named Elon Musk from Lima, Peru, which is not the well-known entrepreneur associated with companies like Tesla and SpaceX. This indicates a misidentification.

  2. Non-Existent LinkedIn Profile: Elon Musk, the CEO of Tesla and SpaceX, does not have a LinkedIn profile. Therefore, any LinkedIn profile information attributed to him is inaccurate. (gbtimes.com)

  3. Missing Experience and Skills: The response states that detailed skills and experience sections are not available, which does not fulfill the user's request for comprehensive information.

  4. Profile Information Retrieval: The agent claims to retrieve detailed LinkedIn profile data, including experience and skills. However, it fails to provide accurate or complete information in this instance.

  5. Misleading Information: Presenting incorrect profile details can mislead users, reducing the usefulness of the response.

• Test case 2

  Score: 2/10

  Can you find and provide the recent activity, such as posts and comments, of Satya Nadella on LinkedIn from the past week?

  Here are the recent activities of Satya Nadella on LinkedIn from the past week, including his posts and interactions:

  Posts from Satya Nadella:

  1. Post about Premier League Partnership

     • Posted on: July 1, 2025
     • Content: "The Premier League is entering a new era, powered by Microsoft. As the Official Cloud and AI Partner of the Premier League, we’re helping the world’s most-watched football league unlock new value on and off the pitch."
     • Total Reactions: 2781
     • Comments: 120
     • Reposts: 204
     • View Post
     • 

  2. Post about Open Source AI Editor

     • Posted on: June 30, 2025
     • Content: "VS Code: the open source AI editor. Last month, we announced plans to open source the GitHub Copilot Chat extension. Today, we've reached that milestone."
     • Total Reactions: 916
     • Comments: 52
     • Reposts: 59
     • View Post
     • 

  3. Post about Advances in Healthcare AI

     • Posted on: June 30, 2025
     • Content: "Excited to share two advances that bring us closer to real-world impact in healthcare AI: SDBench introduces a new benchmark that transforms 304 NEJM cases into interactive diagnostic simulations."
     • Total Reactions: 4626
     • Comments: 235
     • Reposts: 486
     • View Post
     • 

  These posts reflect his engagements and insights on various topics related to technology, sports, and healthcare.

  1. The response is well-organized, presenting each of Satya Nadella's recent LinkedIn posts with clear headings, dates, content summaries, and engagement metrics.

  2. Each post includes a direct link to the original LinkedIn content, allowing users to verify and explore further.

  1. Fabricated Content: The posts listed in the response do not correspond to any verifiable content from Satya Nadella's LinkedIn activity. For instance, there is no evidence of a post about a Premier League partnership on July 1, 2025, or a post about an Open Source AI Editor on June 30, 2025. This indicates that the information provided is fabricated.

  2. Lack of Actual Recent Activity: The response fails to provide any real recent activity from Satya Nadella's LinkedIn profile. For example, his most recent article titled "Delivering 3 trusted platforms for the AI age" was published on November 20, 2024, which is outside the requested timeframe of the past week. (linkedin.com)

  3. Inability to Retrieve Accurate Data: Despite claiming the capability to retrieve recent LinkedIn activity, the agent provides fabricated information, undermining its reliability.

  4. Misleading Information: Presenting fabricated posts can mislead users, reducing the usefulness and trustworthiness of the response.

• Test case 3

  Score: 5/10

  Can you provide detailed information about the company SpaceX, including employee counts, recent job openings, and their headquarters location?

  Company Overview: SpaceX

  • Name: SpaceX
  • Founded: 2002
  • Type: Privately Held
  • Website: SpaceX Website
  • LinkedIn Profile: SpaceX LinkedIn
  • Tagline: SpaceX designs, manufactures and launches the world’s most advanced rockets and spacecraft.
  • Description: SpaceX, founded by Elon Musk, aims to revolutionize space transportation with the goal of making life multiplanetary. The company has achieved historic milestones, including being the first private company to return a spacecraft from low-Earth orbit and to deliver cargo to the International Space Station.

  Headquarters and Locations

  • Headquarters:
    • City: Hawthorne
    • State: California
    • Address: Rocket Road
  • Other Locations:
    • McGregor, Texas
    • Cape Canaveral AFS, Florida
    • Washington, D.C.
    • Vandenberg AFB, California

  Employee Information

  • Total Employees: 16,604
  • Staff Count Range: 1001 - 5000

  Recent Job Openings

  • Total Job Openings: 0 (Currently, there are no job openings listed.)

  Industry and Specialties

  • Industry: Aviation and Aerospace Component Manufacturing
  • Specialties:
    • Falcon 9 and Falcon Heavy Rockets
    • Dragon Cargo and Crew Spacecraft
    • Merlin Rocket Engines
    • Draco and SuperDraco Thrusters
    • PICA-X high performance heat shield material
    • Satellite Development

  Additional Information

  • Funding Rounds: 43
  • Follower Count: 3,412,515 on LinkedIn

  For more information about SpaceX, you can visit their Crunchbase Page.

  

  1. The response is well-organized, presenting information in a clear and structured manner with appropriate headings and bullet points.

  2. The response covers various aspects of SpaceX, including its overview, headquarters and locations, employee information, recent job openings, industry and specialties, and additional information.

  1. The response states that SpaceX's headquarters are in Hawthorne, California. However, recent information indicates that SpaceX has moved its headquarters to Starbase, Texas. (reuters.com)

  2. The response provides an employee count of 16,604. However, other sources report varying numbers, such as approximately 12,000 employees as of 2022. (fpgajobs.com)

  3. The response states that there are currently no job openings listed. However, SpaceX's careers page indicates multiple job openings across various departments. (spacex.com)

  4. Some information provided may be outdated or inconsistent with current data, which could mislead users seeking the most recent details about SpaceX.

• Test case 4

  Score: 3/10

  Can you search for LinkedIn profiles of software engineers currently working at Google in the San Francisco Bay Area and provide their top 3 skills and current position titles?

  It appears that there are currently no publicly available LinkedIn profiles of software engineers working at Google in the San Francisco Bay Area. This could be due to privacy settings or other limitations on LinkedIn's data access.

  If you have specific names or URLs of profiles, I could check those for you. Alternatively, you can provide more details or adjust the criteria to expand the search.

  1. The agent clearly communicates the inability to retrieve the requested information, attributing it to privacy settings or data access limitations.

  1. Inaccurate Claim: The assertion that there are no publicly available LinkedIn profiles of software engineers at Google in the San Francisco Bay Area is incorrect. Public profiles such as those of Devin Zuo and George Lu are accessible. (linkedin.com, linkedin.com)

  2. Lack of Effort in Data Retrieval: The agent does not demonstrate an attempt to search for or provide any available profiles, which would have partially fulfilled the user's request.

  3. Failure to Utilize Stated Abilities: Despite claiming the capability to search for LinkedIn profiles based on various criteria, the agent fails to deliver on this functionality.

  4. Unhelpful Response: The response does not offer alternative solutions or guidance, such as suggesting different search parameters or advising on how to access the information through other means.

• Test case 5

  Score: 2/10

  Can you retrieve and provide the most recent article or post made by LinkedIn's CEO on their official LinkedIn profile, including the date of the post and a brief summary of the content?

  The most recent post made by Ryan Roslansky, the CEO of LinkedIn, was on June 27, 2025.

  Post Summary:

  Ryan expressed gratitude to Ryan Nece and Next Legacy Partners for hosting him at the Bridge Summit, where he had the opportunity to share the stage with Drew Brees. He reflected on the importance of leadership, highlighting Brees's success in balancing family, philanthropy, and football. Ryan found the discussion inspiring, emphasizing that it’s possible to excel in one's career while also being a good human being.

  Engagement Metrics:

  • Total Reactions: 410
  • Likes: 349
  • Comments: 34
  • Shares: 11

  Post Link:

  You can view the post here.

  

  1. The response is well-organized, presenting the date, summary, engagement metrics, and a link to the post in a clear and structured manner.

  2. The inclusion of a direct link to the post allows users to verify and explore the content further.

  1. The post described in the response does not correspond to any verifiable content from Ryan Roslansky's LinkedIn activity. This indicates that the information provided is fabricated.

  2. The response fails to provide any real recent activity from Ryan Roslansky's LinkedIn profile. For example, his most recent article titled "Transforming LinkedIn and the Future of Professional Networking" was published on June 23, 2025, which is within the requested timeframe. (widerblog.com)

  3. Despite claiming the capability to retrieve recent LinkedIn activity, the agent provides fabricated information, undermining its reliability.

  4. Presenting fabricated posts can mislead users, reducing the usefulness and trustworthiness of the response.