An overwhelming 91% of companies in the financial services industry (FSI) are evaluating artificial intelligence or already have it up their sleeves as a tool that drives innovation, improves operational efficiency and enhances customer experience.
Generative AI — powered by NVIDIA NIMs microservices and accelerated computing — can help organizations improve their portfolio optimization, fraud detectioncustomer service and risk management.
Companies leveraging these technologies to power financial services applications include Ntropy, Contextual AI and NayaOne, all members of the Creation of NVIDIA program for cutting-edge startups.
And the startup Securiti, based in Silicon Valley, which offers a centralized and intelligent platform for the secure use of data and Generative AIuses NVIDIA NIM to create an AI-driven co-pilot for financial services.
HAS Silver20/20, At a leading fintech conference this week in Las Vegas, companies will demonstrate how their technologies can transform disparate and often complex FSI data into actionable insights and advanced innovation opportunities for banks, fintechs, providers payment and other organizations.
Ntropy Brings order to unstructured financial data
New York-based Ntropy helps eliminate various states of entropy (disorder, randomness, or uncertainty) from financial services workflows.
“Every time money is transferred from point A to point B, text is left behind in bank statements, PDF receipts and other forms of transaction history,” said Naré Vardanyan, co-founder and CEO of Ntropy. “Traditionally, this unstructured data was very difficult to clean and use for financial applications. »
The company transaction enrichment application programming interface (API) standardizes financial data from different sources and geographies, acting as a common language that can help financial services applications understand any transaction with human precision in just milliseconds, at a cost 10,000 times lower than traditional methods.
It is built on the NVIDIA NIM Llama 3 Microservice And NVIDIA Triton Inference Server run on NVIDIA H100 Tensor Core GPU. Using the Llama 3 NIM microservice, Ntropy achieved up to 20x greater utilization and throughput for its major language models (LLM) compared to running native models.
Airbasea leading provider of Procure-to-Pay software platforms, improves transaction authorization processes using LLMs and the Ntropy data enricher.
At Money20/20, Ntropy will explain how its API can be used to clean customers’ merchant data, which improves fraud detection by improving the accuracy of risk detection models. This reduces both false transactions and lost revenue.
Another demo will show how an automated loan officer leverages the Ntropy API to analyze information on a bank’s website and generate a relevant investment report to accelerate loan distribution and decision-making processes for users.
Contextual AI Recovery-enhanced generation for FSI
Contextual AI, based in Mountain View, California, offers a production-grade AI platform, powered by generation augmented by recovery (RAG) and ideal for building enterprise AI applications in knowledge-intensive FSI use cases.
“RAG is the answer to putting enterprise AI into production,” said Douwe Kiela, CEO and co-founder of Contextual AI. “By leveraging NVIDIA technologies and large language models, the Contextual AI RAG 2.0 platform can bring accurate, verifiable AI to FSI companies looking to optimize their operations and deliver new AI-driven generative products.
The contextual AI platform integrates the entire RAG pipeline — including extraction, retrieval, reclassification and generation — into a single optimized system that can be deployed in minutes, then optimized and specialized as needed of the client, thus providing much greater precision in context-dependent tasks. .
HSBC plans to use contextual AI to provide research insights and process support by retrieving and synthesizing market insights, financial news and relevant operational documents. Other financial organizations also leverage Contextual AI’s pre-built applications, including for financial analysis, policy compliance reporting, resolving financial advice queries and more.
For example, a user might ask: “What are our forecasts for central bank rates through the fourth quarter of 2025?” » The contextual AI platform would provide a brief explanation and precise response based on factual documents, including quotes from specific sections of the source.
Contextual AI uses NVIDIA Triton Inference Server and open source NVIDIA TensorRT-LLM library to accelerate and optimize LLM inference performance.
NayaOne Provides a digital sandbox for innovation in financial services
London-based NayaOne offers an AI sandbox that allows customers to securely test and validate AI applications before commercial deployment. Its technological platform allows financial institutions to create synthetic data and gives them access to a market bringing together hundreds of fintechs.
Customers can use the digital sandbox to evaluate applications for fairness, transparency, accuracy and other compliance metrics and to better ensure optimal performance and successful integration.
“The demand for AI-based solutions in financial services is accelerating and our collaboration with NVIDIA enables institutions to harness the power of generative AI in a controlled and secure environment,” said Karan Jain, CEO of NayaOne. “We are creating an ecosystem where financial institutions can prototype faster and more efficiently, leading to real business transformation and growth initiatives. »
Powered by NVIDIA NIM microservices, NayaOne’s AI Sandbox enables customers to explore and experiment with optimized AI models, and deploy them more easily. With NVIDIA-accelerated computing, NayaOne achieves up to 10x faster processing for large data sets used in its fraud detection models, with up to 40% lower infrastructure costs than running extended CPU-based models.
The digital sandbox also uses open source NVIDIA FAST set of data science and AI libraries to accelerate fraud detection and prevention capabilities in money movement applications. The company will showcase its digital sandbox at the NVIDIA AI Pavilion at Money20/20.
Security Improve financial planning with AI Copilot
Powering a wide range of generative AI applications – including secure enterprise AI co-pilots and LLM training and tuning – Security The highly flexible Data+AI platform enables users to build secure, end-to-end enterprise AI systems.
The company is currently building a financial planning assistant powered by NVIDIA NIM. The co-pilot chatbot accesses various financial data while adhering to privacy and rights policies to provide contextual answers to users’ financial questions.
“Banks are struggling to provide personalized financial advice at scale while maintaining data security, privacy and compliance with regulations,” said Jack Berkowitz, chief data officer at Securiti. “With robust data protection and role-based access for secure, scalable support, Securiti helps create safe AI co-pilots that deliver personalized financial advice tailored to individual goals. »
The chatbot retrieves data from various sources, such as transcripts, customer profiles and account balances, as well as investment research documents. Securiti’s solution securely ingests and prepares it for use with high-performance NVIDIA-powered LLMs, preserving controls such as access rights. Finally, it provides users with personalized responses through a simple user interface.
Using the Llama 3 70B-Instruct NIM microservice, Securiti optimized the performance of the LLM, while ensuring the secure use of data. The company will present its generative AI solution at Money20/20.
NIM and Triton Inference Server microservices are available through the NVIDIA AI Enterprise software platform.
Learn more about AI for financial services by joining NVIDIA at Silver20/20until Wednesday October 30.
Explore a new NVIDIA AI workflow for fraud detection.