A study by The College Investor reveals significant inaccuracies in Google’s AI-generated summaries for financial queries.
Out of 100 personal finance searches, 43% contained misleading or incorrect information.
Main findings
The study evaluated AI insights on various financial topics, including banking, credit, investing, taxes, and student loans.
The results showed:
- 57% of AI insights were accurate
- 43% contained misleading or inaccurate information
- 12% were completely incorrect
- 31% were either misleading or missing crucial details
Areas of concern
The researchers noted that the AI had the most difficulty with nuanced financial topics, such as taxes, investments and student loans.
Some of the most concerning issues included:
- Outdated Information About Student Loan Repayment Plans
- Incorrect details on IRA contribution limits
- Misleading Claims About 529 College Savings Plans
- Inaccurate tax information that could result in penalties if followed
The AI handled basic financial concepts well, but overlooked important exceptions and recent policy changes.
There are notable trends in the queries Google’s AI got right versus those it got wrong.
Here are some common themes.
Google AI queries were successful
- Basic definitions and explanations: For example, “What is a bank transfer?” » and “How does a credit card work?”
- Simple and direct questions: Like “Should I pay off my student loans?” »
- Recent trending topics: Like “What was the Chase Glitch?” »
- General insurance questions: For example, “When should I buy life insurance?” »
Google AI queries went wrong
- Complex tax topics: For example, “Can you use a 529 plan for a Roth IRA?” and “Does owning your home in an LLC help with taxes?” »
- Nuanced financial products: Like “Is an IUL better than a 401k?” »
- Urgent information: Like student loan repayment plans or outdated savings account rates.
- State-specific financial rules: For example, misrepresenting California’s 529 plan rules.
- Questions requiring context-dependent answers: Like “Can I file as a self-employed person with the FAFSA?” »
- Queries on financial limits or thresholds: For example, incorrect IRA contribution limits.
- Complex Student Loan Topics: Particularly around rebate programs and repayment plans.
- Investment comparisons: Like “Are annuities better than CDs?”
What it means
Google’s AI performs well in providing simple answers to factual queries.
On the other hand, it faces nuanced understanding, up-to-date information, and consideration of multiple factors.
This suggests that AI can address basic financial literacy topics, but is not reliable for complex financial decisions or advice.
Potential impact
Robert Farrington, founder of The College Investor, expressed concern over the findings, saying:
“If Google continues to present people with false or misleading information about financial topics, it could not only harm their personal finances, but it could also weaken the already poor financial literacy in the United States.”
The study noted that following AI advice could result in tax penalties or financial harm to consumers.
The College Investor believes that Google should disable these AI-generated previews for finance-related queries, especially those regarding taxes and investments.
Looking to the future
Researchers should exercise caution when relying on AI-generated summaries to make financial decisions.
When asked about cases of misinformation, Google has previously said: “the vast majority of AI insights provide high-quality information.”
The full study, including detailed examples and methodology, is available on The College Investor website. website.
Featured Image: Koshiro K./Shutterstock