By integrating data from both traditional and non-traditional sources as context, Retrieval-Augmented Generation enriches the LLM to support downstream GenAI systems.
FinTech BizNews Service
Mumbai, June 2, 2025: Gartner Inc. predicts that organizations will develop 80% of Generative AI (GenAI) business applications on their existing data management platforms by 2028. This approach will reduce the complexity and time required to deliver these applications by 50%.
During the Gartner Data & Analytics Summit today in Mumbai, Prasad Pore, Sr Director Analyst at Gartner, said, “Building GenAI business applications today involves integrating large language models (LLMs) with an organization’s internal data and adopting rapidly evolving technologies like vector search, metadata management, prompt design and embedding. However, without a unified management approach, adopting these scattered technologies leads to longer delivery times and potential sunk costs for organizations.”
As organizations aim to develop GenAI-centric solutions, data management platforms must evolve to integrate new capabilities or services for GenAI development, ensuring AI readiness and successful implementation.
Enhancing GenAI Application Deployment With RAG
Retrieval-augmented generation (RAG) is becoming a cornerstone for deploying GenAI applications, providing implementation flexibility, enhanced explainability and composability with LLMs. By integrating data from both traditional and non-traditional sources as context, RAG enriches the LLM to support downstream GenAI systems.
“Most LLMs are trained on publicly available data and are not highly effective on their own at solving specific business challenges,” said Pore. “However, when these LLMs are combined with business-owned datasets using the RAG architectural pattern, their accuracy is significantly enhanced. Semantics, particularly metadata, play a crucial role in this process. Data catalogs can help capture this semantic information, enriching knowledge bases and ensuring the right context and traceability for data used in RAG solutions.”
To effectively navigate the complexities of GenAI application deployment, enterprises should consider these key recommendations:
Gartner clients can learn more in “Predicts 2025: 4 Ways AI Will Disrupt Data Management Markets and Solutions.”
Learn how to ensure that your data is ready for use in the specific AI initiatives you plan to pursue in the complimentary Gartner AI-Ready Data Essentials Roadmap.
Gartner Data & Analytics Summit
Gartner analysts are providing additional insights on the evolving landscape of data, analytics and AI, focusing on adeptly balancing opportunity and risk while ensuring business value at the Gartner Data & Analytics Summit in Mumbai today and tomorrow. Upcoming conferences include June 17-18 in Sydney.