Databricks Unveils New Tools to Make AI Agents Scalable, Accurate, and Easy to Manage

SINGAPORE, March 12, 2025 – Databricks has introduced a suite of new tools designed to help enterprises deploy AI agents at scale while ensuring accuracy, governance, and seamless integration. As businesses increasingly adopt Generative AI (GenAI), many still struggle to move beyond pilot projects due to concerns about data relevance, model governance, and real-world effectiveness.

The latest innovations from Databricks aim to tackle these challenges head-on, making AI more trustworthy, adaptable, and easy to manage in mission-critical applications.

Helping Enterprises Move Beyond AI Pilots

Although 85% of global enterprises now use Generative AI in some form, many models still lack the ability to deliver business-specific, reliable insights. The primary reason? AI models often struggle with understanding enterprise-specific data, leading to inconsistent results.

Databricks’ new tools offer solutions that enable companies to deploy AI agents with confidence, ensuring that AI-driven insights are accurate, well-governed, and seamlessly integrated into existing workflows.

Key Innovations to Enhance AI Adoption

Databricks is rolling out four major updates aimed at simplifying AI governance, integration, evaluation, and scaling:

Unified AI Governance with Mosaic AI Gateway – A centralized system to manage both open-source and proprietary AI models, ensuring compliance, security, and seamless integration. This means businesses can mix and match different AI models while maintaining strict oversight.

Conversational AI with Genie API – A new conversational AI suite that lets developers embed AI-powered chatbots into productivity tools like Microsoft Teams, SharePoint, and Slack. The Genie API retains context across conversations, making interactions more natural and effective.

Human-Guided AI Improvements – The Agent Evaluation Review App streamlines how teams assess and improve AI performance. Instead of using spreadsheets or custom-built systems, domain experts can now provide structured feedback and fine-tune AI models with ease.

Simplified AI Scaling with Batch AI – A new provision-less batch inference tool allows enterprises to run large-scale AI models using just a single SQL query—no infrastructure setup required. This significantly reduces costs and makes AI integration more accessible for businesses.

A Game-Changer for Enterprise AI

For companies like Altana, which is already using the new Batch AI feature, the impact has been immediate.

“Batch AI with AI Functions is streamlining our AI workflows, allowing us to integrate large-scale AI inference with a simple SQL query—no infrastructure management needed. This has dramatically accelerated our developer velocity,” said Ian Cadieu, CTO of Altana.

Craig Wiley, Senior Director of Product for AI at Databricks, highlighted the confidence gap that many enterprises face when adopting AI, “Many enterprises struggle to deploy AI agents in high-value applications due to concerns around accuracy, governance, and security. The new tools address these challenges head-on, enabling businesses to move beyond pilots and into full-scale production with AI agents they can trust.”

Mosaic AI Gateway, Genie Conversation API suite, Agent Evaluation Review App, and Batch AI are now available in Public Preview. With these advancements, Databricks is setting the stage for smarter, more reliable AI agents that enterprises can confidently deploy at scale.