As surely as autumn and winter follow summer, the current exuberance around AI is not going to last simply because the machines remain incapable of living up to the expectations that have been set for them.
These cycles typically take the form of a discovery of some description followed by a ramping of expectations which in turn leads to large amounts of money being invested for fear of missing out (FOMO).
The problem is that the expectations that are set are always unrealistic, meaning that when the time comes to deliver on those expectations, disappointment sets in. This is followed by collapsing valuations, bankruptcies and forced consolidation as investors are no longer willing to suspend disbelief.
This is the fourth AI Hype cycle with the others occurring in the 1960s, 1980s and 2017-2019, and this hype cycle looks exactly the same as the others except that it is much larger. Looking at investment activity and news flow, it is also very clear exactly where we are in the cycle.
First, expectations
- The ability of Large Language Models (LLMs) to mimic human behavior has convinced some of the big names (like Professor Geoffrey Hinton) that artificial superintelligence is now materially closer than it was before.
- While LLMs do have some very useful and lucrative use cases, they still have no causal understanding of the tasks they are performing.
- This is why they hallucinate, make the most basic factual errors and are generally completely unreliable.
- Therefore, the machines remain as stupid as ever. There is no evidence whatsoever that these machines are able to think.
- But the problem is that they are so good at pretending to think that they are able to fool the great minds that created them.
- Instead, all they do is calculate statistical relationships, meaning that the big promises that have been made will not be kept.
Second, investment
- There are already many examples of money being thrown at start-ups with valuations and fundamentals being an afterthought:
- OpenAI’s $30-billion valuation with a corporate culture that doesn’t want to make any profit.
- Inflexion AI raising $1.3 billion from Microsoft and NVIDIA at an estimated valuation of around $5 billion despite having only been around for a year and having no commercial product.
- Mistral AI raising $113 million at a $260-million pre-money valuation despite being only a few weeks old with no revenues, no product and probably only the vaguest idea of what it is going to do.
- This can be described as the very definition of a bubble where rationality gets lost in the mad rush toward the next big thing. A lot of shirts are going to be lost.
The latest innovations around LLMs have produced some remarkable abilities which, no doubt, will be put to both good and lucrative use. However, the technology upon which they are based has not changed, meaning that the limitations that prevented digital assistants and autonomous driving from being useful for anything more than the most basic tasks are also going to trip LLMs up.
Furthermore, this is no longer the exclusive realm of the big, well-financed companies that can pay tens of millions of dollars for massive compute capacity, as the hobbyists and enthusiasts are now creating generative AI. Meta Platforms’ series of LLMs called LlaMa are now freely available to anyone who wants to tinker and advances in training techniques have meant that it is possible to fine-tune a 7bn parameter model on a powerful laptop.
This is why there are models popping up all over the place that are completely free to use. Some of them actually work quite well. Hence, the pricing of $20 per month for services like GPT-4, Perplexity AI and Midjourney may soon come under relentless pressure. This is really bad news for investors relying on spreadsheets for their return because no one seems to have modeled this scenario out.
The first sign of trouble will come when companies come back to the market after spending the money on fancy offices and expensive staff but nothing to show for the investments so far. This is when the down rounds begin, disillusionment sets in, reality makes its presence felt and winter begins.
One suspects this will begin sometime in the first half of 2024 and the fallout will not be pretty.
(This guest post was written by Richard Windsor, our Research Director at Large. This first appeared on Radio Free Mobile. All views expressed are Richard’s own.)
