Most people tend to associate artificial intelligence with regular chatbots, developed to retrieve predefined answers and regurgitate information back to the user in mere seconds. Although their capabilities are shocking, this commercialized AI is only a small part of AI's capabilities. Today's generative AI models can draft full earnings releases, create deceiving images, and push updates through media outlets that can cause millions of dollars of mishandled money.

AI in Financial Markets

In the financial world, generative AI has a shocking ability to process market-relevant signals and actively make decisions in seconds. What used to be a cycle of people reacting to news and then adjusting their trading positions has now turned into an automated loop between social media platforms and trading algorithms that make decisions based on the news.

The Pentagon Fake Image Incident

This relationship between AI-generated content and trading algorithms was clearly illustrated in May 2023, when a fake image of smoke near the Pentagon hinted at a potential attack on the U.S. Although the image was soon exposed as fake, the damage had already been done: within just four minutes, the Dow Jones Industrial Average fell by 85 points and the S&P 500 declined by around 0.3%. A few hours later, as the image spread again, both indexes sharply rebounded, underscoring how one fabricated headline triggered whipsaw volatility in the markets. The broader takeaway is that while AI promises speed and responsiveness, it also highlights a critical weakness — machines often struggle to assess the validity of information in real time.

Speed vs. Herd Behavior

Response speed isn't the only issue — herd behaviour in investing is more drastic than ever before. Traditionally, when AI-generated stories land on every screen at once, they push investors to move as a crowd. However, as human-operated traders are starting to be replaced with algorithms derived from generative AI, these mechanisms react to the signals simultaneously with lower reaction times, causing a stampede of trades instead of a more gradual increase in trading volume.

One notable example surfaced during 2024, when online fraudsters distributed AI-generated videos of Elon Musk promoting a new cryptocurrency platform called Quantum AI. After these videos began populating across social media platforms worldwide, blockchain forensics firms noted a surge of deposits into wallets that were related to the scam. When institutions like the Central Bank of Ireland and Hong Kong's Securities and Futures Commission began to call out the fraudulent platform, there was an equally abrupt outflow of money from the accounts. This sharp wave of money flowing in and out produced a massive spike in traded volume, creating systemic instability.

Regulatory Blind Spots

A clear by-product of this contest between AI mechanisms is the widening of blind spots in financial regulations. Financial-market rules were primarily written for human investors who file 10-Ks, report quarterly earnings, and can be punished for not abiding by the SEC's regulations. However, Generative AI mechanisms can slip through the cracks of the SEC's framework, and cannot be held accountable for their actions as current policies do not mandate authentication protocols or content-origin tracing.

A telling example of regulatory vulnerability came in February 2024, when Lyft's earnings release mistakenly projected a 500-basis-point margin expansion instead of 50. The error sent the stock up 67% in just 42 minutes, briefly adding $3 billion in market value before the correction erased the gains. If a similar distortion were AI-generated and spread across social media, the market impact could be just as severe while responsibility would be far harder to assign.

As financial institutions compete to become more efficient, it is clear that AI-generated mechanisms have revolutionized the trading of securities. From tightening reaction times to seconds, fueling herd behavior through identical trades, and slipping through outdated regulations, financial markets have become increasingly volatile. The responsibility now lies with regulators to stabilize markets roiled by rapid-fire trading — but the ultimate question remains: how will regulation evolve to parallel this technological revolution?

References

Niemeyer, Kenneth. "A Hong Kong-based Crypto Exchange Used Deepfakes of Elon Musk." Business Insider, May 2024.

Sellman, Mark. "US Stock Market Falls after AI Fake of Pentagon 'Explosion.'" The Times, 23 May 2023.

Stempel, Jonathan. "Lyft Wins Dismissal of Shareholder Lawsuit over Earnings Report Error."