Urgent Demand for Responsible AI in Financial Operations
New research reveals financial executives’ concerns and expectations for AI in finance.
HAMILTON TOWNSHIP, New Jersey, November 18, 2025 /PRNewswire/ — Billtrust, a leader in B2B accounts receivable (AR) payment and workflow software, has released insightful findings from a new research study exploring the confidence levels of financial executives in artificial intelligence (AI). The study indicates that 82% of finance professionals express concerns regarding the potential for AI misuse, particularly in areas of fraud and financial crime.
Understanding the Growing Concerns Over AI Misuse
The report, titled “Confidence in AI: What Financial Executives Need to Embrace Artificial Intelligence”, reveals the increasing sophistication of fraudulent techniques empowered by AI. These include risky practices such as voice cloning, deepfake video calls, and intricately designed fake invoices. Alarmingly, nearly half of the surveyed executives (45%) reported encountering AI-generated phishing emails, while 29% noted instances where AI voice cloning was employed to impersonate familiar contacts.
Trust Through Responsible Implementation
“While financial leaders are keen to adopt AI technologies, they also emphasize the necessity for responsible implementation,” stated Ahsan Shah, senior vice president of AI and analytics at Billtrust. “Our findings showcase that trust in AI is heavily reliant on transparency, human oversight, and strong ethical guidelines—elements that are essential, not optional.”
Key Insights from the Research
- 76% of respondents believe they can detect fraudulent invoices before payment, despite many reporting at least six suspicious invoices monthly.
- 27% of organizations either do not monitor suspicious activity or are unsure about their tracking, emphasizing a notable gap in transparency.
- A significant 83% of financial organizations plan to implement AI-driven solutions within the next two years.
A Framework for Responsible AI in Finance
The study outlines a framework aimed at promoting responsible AI deployment in financial operations, with emphasis on key areas:
- Incorporating human-in-the-loop architectures for effective monitoring and decision-making.
- Ensuring transparency and explainability in AI-generated results.
- Implementing continuous governance and regular performance evaluations.
- Aligning deployment strategies with organizational values to ensure ethical standards.
- Establishing robust digital infrastructures that support scalable and reliable AI systems.
The Evolving Role of AI in Financial Operations
Finance teams are increasingly utilizing AI to identify anomalies and reduce manual tasks. “Although AI is enhancing operational efficiency, the systems need to maintain visibility and control throughout the scaling process,” added Shah. “At Billtrust, we are dedicated to developing AI solutions that enhance human expertise rather than replace it.”