As organizations navigate this landscape, they’ll need to balance the immediate benefits of specialized tools against the long-term costs of managing a complex multi-vendor environment. The resolution of this tension will shape the enterprise AI landscape for years to come.
In 2025 and beyond, large enterprises face an interesting challenge: the proliferation of AI agent builder tools from major technology vendors. As these platforms become central to enterprise operations, organizations must navigate a complex landscape of overlapping capabilities, competing vendor priorities, and governance challenges.
The Major Players
The enterprise AI agent builder space is rapidly becoming crowded with significant players:
• Salesforce has made a “full company pivot” with Agentforce, marking this as a strategic direction for their future. Marc Benioff, Salesforce co-founder, chair, and CEO, characterizes this shift as providing a “digital workforce” where humans and automated agents collaborate to achieve customer outcomes. (McKinsey)
• Microsoft is pushing forward with Copilot Studio and their Microsoft Agents ecosystem. Their late 2024 launch enables customers to create autonomous AI agents through Copilot Studio with minimal coding requirements, targeting tasks from client inquiries to inventory management. (Reuters)
• Google is entering the space with Vertex Agent Builder and the upcoming Agentspace.
• Atlassian has launched Rover, expanding beyond their traditional DevOps focus.
• ServiceNow has entered the arena, even pushing into CRM territory.
• SAP and other enterprise software giants are developing their own agent builders.
What’s particularly notable is that most large enterprises already use multiple vendors from this list. Each vendor is treating AI agents as their core strategic product direction, setting up an inevitable collision course within enterprise IT environments.
The Integration Challenge
While these tools often start with “no-code” or “low-code” approaches—some even allowing agent creation through natural language prompting—they can scale up to more complex implementations with custom code and connectors. This accessibility is both a feature and a potential problem, as it could lead to rapid proliferation of agents across different departments.
The vendors aren’t limiting themselves to their traditional domains either. Take Atlassian, for example: while one might expect them to focus purely on DevOps given their Jira and Bitbucket heritage, they’re actively pursuing use cases well beyond this scope. This expansion of scope across vendors creates significant overlap in capabilities.
Data: The Supposed Moat
Vendors are positioning their access to specific data sources as a competitive advantage. Salesforce emphasizes their customer data connections, SAP their financial data integration, and Microsoft and Google their deep hooks into enterprise knowledge bases. However, this advantage might be less substantial than it appears.
Most of these data sources are fundamentally API-driven. While native connectors offer convenience, they don’t necessarily create an insurmountable technical barrier for competing platforms. The real question becomes: does native integration offer enough value to justify using a specific vendor’s agent builder?
The IT Governance Challenge
Enterprise IT teams typically resist tool proliferation, preferring standardization and consolidation. However, they’re likely to face strong arguments from different divisions about the need to use tools that best integrate with their specific data and workflows. This creates a tension between:
• Divisional autonomy and effectiveness
• Enterprise-wide governance and efficiency
• Security and compliance requirements
Security and Compliance: The Forcing Function
While initial deployment might see a sprawl of different tools, security and compliance requirements will likely force organizations to rationalize their agent builder platforms down to a smaller number. Managing security controls, access policies, and audit trails across multiple AI agent platforms becomes exponentially more complex with each additional tool.
This is particularly critical in regulated industries where organizations need to demonstrate comprehensive oversight of AI systems, including:
• Data lineage and handling
• Model governance
• Decision audit trails
• Bias monitoring
• Access controls
As Deloitte aptly notes, “Autonomous generative AI agents could increase the productivity of knowledge workers and make workflows of all kinds more efficient.” However, they also emphasize the importance of dynamic AI governance to manage the unique challenges posed by these systems. (Deloitte)
Looking Ahead
McKinsey highlights how the evolution of generative AI agents is opening new opportunities across organizations. These agents can orchestrate complex workflows, coordinate activities among multiple agents, apply logic, and evaluate answers, thereby automating processes or augmenting workers and customers in performing tasks. (McKinsey)
Beyond the major players discussed above, Gartner’s reviews indicate that platforms like IBM watsonx Assistant, Yellow.ai, Kore.ai Experience Optimization (XO) Platform, and AiseraGPT are making significant strides in the enterprise conversational AI space, further complicating the vendor landscape. (Gartner)
How will this play out? We might see an initial period of experimentation and proliferation, followed by consolidation around the platforms that demonstrate the strongest performance and governance capabilities. The winners in this space will likely be those who can:
1. Provide robust security and compliance features.
2. Offer genuine advantages in their core domains while supporting broader use cases.
3. Demonstrate meaningful benefits from their native integrations.
4. Support enterprise-wide governance while maintaining divisional flexibility.
As organizations navigate this landscape, they’ll need to balance the immediate benefits of specialized tools against the long-term costs of managing a complex multi-vendor environment. The resolution of this tension will shape the enterprise AI landscape for years to come.
Sign up to receive our newsletter that deep dives into different AI Agent use cases each week.
