Bots Predicted to Dominate Online Traffic by 2027
According to Cloudflare CEO Matthew Prince, bots are poised to take over the internet. In a recent interview at SXSW in Austin, he predicted that the rapid growth of artificial intelligence will mean that by 2027, bot traffic will surpass human traffic online.
Rapid Growth of Bot Activity
Prince highlighted that the increasing prevalence of generative AI technology is driving this surge in bot traffic. Bots can visit significantly more websites than any human could, providing users with quicker and more comprehensive answers to their inquiries.
Comparative Site Visits by Bots
To illustrate this point, Prince noted that while a human shopper might visit five websites when searching for a digital camera, a bot could navigate up to 5,000 sites. This increased activity translates to tangible web traffic, which poses new challenges that the industry must address.
Historical Bot Traffic Trends
Before the advent of generative AI, bots accounted for only about 20% of web traffic, with Google’s web crawler being the most prominent. Aside from a few reputable crawlers, the remaining bots were primarily employed by scammers and malicious actors, according to Prince, whose company provides infrastructure and security services to one-fifth of all websites.
Emerging Technologies for AI Agents
Prince emphasized that the anticipated increase in bot traffic would necessitate the creation of innovative technologies, such as dynamic sandboxes for AI agents. These sandboxes would allow users to request AI agents to perform specific tasks, such as planning a vacation, by spinning up and then dismantling these temporary environments as needed.
Infrastructure Demands for Growing Bot Traffic
With bots set to proliferate, there will be increased demand for robust physical infrastructure, including data centers and servers. Prince recalled how, during the COVID-19 pandemic, internet traffic surged, particularly among streaming platforms, overwhelming parts of the internet due to the sudden strain.
Cloudflare’s Role in Addressing Internet Traffic Challenges
Despite the challenges posed by this transformation, Cloudflare stands positioned to help manage the demands of a growing digital landscape. Their array of services, including a content delivery network and comprehensive security solutions, ensures that websites remain responsive and secure from attacks. Additionally, businesses can utilize tools to mitigate unwanted AI bot traffic.
AI as a Revolutionary Platform
Prince concluded by asserting that the rise of AI represents a significant platform shift in how information is consumed, much like the transition from desktop to mobile. This shift will undoubtedly reshape the landscape of online interactions and information retrieval.