Remember when GPUs were the dominant tech to mine crypto, then ASICs and other spepcialized purpose-built hardware came out and made GPUs irrelevant for mining, wont that also happpen in regards to ai training/inference. like aws is attemppting to do with their trainium/inferentia chips. Sure they suck now, but won't they get better and thus lose the dependency on GPUs?
NVIDIA GPUs stopped being GPUs a while ago, that didn’t happen for crypto, but now it seems the will drop the entire customer graphics market long term they just haven’t committed themselves to it. They can’t go back to GPUs anyway there are not enough gamers to reach the revenue numbers they need now and soon their revenue will be irrelevant.
It's already happened hasn't it. Google's TPUs are apparently much more efficient at inference workloads. However the hardware isn't available to the public like Nvidia chips are.
I'm unsure about the energy efficiency of Tenstorrent cards, but they are at the moment much more cost effective than Nvidia. But software support is far behind, I suspect if it wasn't the cost would be more equal.
Basically capacity issues. NVidia + Apple have bought up a significant portion of TSMC's manufacturing capacity. The primary supplier for Google's TPUs is Broadcom, with TSMC as a second source, and they're trying to ink contracts with other suppliers like MediaTek, but there're only so many semiconductor fabs in the world and TPUs need a fairly modern process.
Within Google itself the TPUs are definitely preferred for AI workloads, you just can't always get them.
Crazy that a company can use a contract to buy up all the supply to build an inferior product that’s less energy efficient and then sell it at a higher price than the purpose built counterpart. Market failure.
TPUs are a systolic array. It's not comparable to the hardware architecture that backstops CUDA, nor do they serve the same markets.
The writing was on the wall for TSMC ever since the 5nm node; Apple proved that anyone with enough liquid cash could block competitors from fab access.
Broadcom isn't a chip foundry so calling it Google's supplier doesn't make sense. TSMC has been the primary manufacturer of TPUs but Google's hoping to use Samsun and Intel also going forward (and these are the only leading edge foundries in the world). Broadcom is co-developer of the chip.
google doesn't use them, they buy them to make them available for google cloud customers that require CUDA or other nvidia-only workloads. All training and inference at Google is done on TPUs.
You have basically managed to sum up why NVDA keeps dominating, no on can "just buy a few TPUs" and that has been the case since the first TPUs were announced years ago (yes yes GPU shortages and so on, but no one questions general availability of GPUs), and the current Tenstorrent model support page looks like an invitation to beta test HW that might (or might not) be able to run current and future models at some point.
But the next gen of Tenstorrent HW looks great on paper - problem is, I could have written that before the current gen was released.
All of the allegedly competing HW looks like that and has looked like that for years, either a lack of availability, capability, or both.
To be fair GPUs have already changed a lot in response to the AI demands. A lot of silicon these days are tensor cores which have very few applications outside of deep learning.
There are also the opposing architectural directions to extend toward:
one in the "Cerebras" direction of ever-larger scale general purpose HPC silicon running inference workloads. Cerebras may have skipped ahead to the last act of that scaling story, notwithstanding any further wafer-diameter enlargements past 300mm. Whether the ending is happy or not is still unclear. Lot of iterative room to grow into it further and they have a formidable patent moat waiting for conventional die-sized AI semi vendors when they inevitably run up against limitations of single-die designs.
the other is in the "Taalas" direction of freezing a specific model into something like high speed ROM / FPGA and getting orders of magnitude inference speed improvements - for that specific model. Like Cerebras, Taalas may also have jumped directly to the architectural telos of that philosophy, with only iterative improvements in cost per work unit left to grind, though like CBRS quite a lot of grinding left to do especially in getting cost per custom tapeout down to near-disposable (hopefully, recyclable) levels.
Yes. Half dozen companies are designing special chips to bypass/replace the GPU.
Bitcoin was lucky for Nvida, then AI was lucky. Third times the charm?
On other hand, luck favors the prepared. Beyond luck, they did make their chips accessible, easier to program than other GPU's. So bitcoin miners and then AI could utilize them.
There are still a lot of people that want to run regular liner algebra.
This is why I think their pivot/venture to general robotics was smart. However, I doesn't seem like they will become profitable on that front because they were outcompeted pretty hard in most measures I can conjure.
Mining ASICs are bound to a single cryptographic hashing algorithm, meaning they do one thing and they do it very fast. Something similar may make sense for running models locally, but I believe the more multifaceted Nvidia chips make more sense for training.
Taalas takes a similar approach but at a much higher level of complexity - instead of an array of nnn tiny specialized cryptographic cores running the same algo (or a mix of several with interlocking dependencies), it freezes a single entire LLM on to one die, running inference both far faster and cooler than any general purpose compute but with the same one trick pony obsolescence drawback. Question remains whether high volume fab tech can be wrangled into a form that allows this approach to drop unit costs near "disposable/recyclable" levels of cheapness per chip. This also may not matter when models all start to converge on a 'good enough' level of coverage for specific domains that the chips can remain productive for 3-4 years before needing a recycle.
Check out Taalas, recently acquired by AMD. They printed a model directly to silicon and it generates 16,000 tokens per second. You can even try a demo here:
Cerebras don't need to customise their chips. To my knowledge they are crazy fast but struggle to fit larger models and it's not clear they're economically favourable.
Ethereum's work function was designed to be memory bandwidth limited, which is something gous are already quite well optimised for. An asic would be faster but not by enough to be worth the investment, at least while gpu margins were less crazy.
The main thing is the actual number crunching and memory interfaces for LLMs are not crazy hard to implement, and the potential scale is huge, so NVIDIA's moat is not likely to be big enough to make their current margins sustainable in the longer run.
Not to mention, many ASICs were outclassed by a few well-tuned GPUs in terms of power-efficiency. There were only a few coins that bucked that trend, usually just altcoin/shitcoin experiments that weren't worth mining in the first place.
I'm kinda bewildered, it's bizarre seeing people cheer on quickly-obsolete accelerators instead of demanding their OEM to adopt GPGPU. CUDA will be relevant for much longer than any ASIC can ever be, even (or especially) if the transformer gets replaced overnight with a better architecture.
Post hoc rationalization. Nothing in here was unknown on 10/29 when the scandal broke, yet the stock market value was pretty durable before this and dropped a ton after.
It does make me wonder if this is a concerted press attack by short sellers.
All the stuff about Jensen's affairs, NVidia sales to China, circular financing, increasing competition in the market, etc. was known months ago. Indeed, much of it came out in research notes by major short-selling funds. And NVDA is an extremely attractive target for shorts, having been bid up high by the AI bubble and then having a lot of retail interest that could easily be pushed the other way. Entirely possible that certain funds have taken a large short interest and are now trying to give it that push to profit.
Common saying. I always wonder how the stock market would have priced pick sellers? Would they have baked in 10 years of continued revenue growth from the sale of picks?
> It's peak delusion to think that AI is going away.
Even if it's not going away, it'll be a breath of fresh air when it's not shoved into every possible place as a marketing tactic, even when it's not necessary or beneficial. AI does have it's place, I just hope we realize soon how every place is not that place.
I don't think LLMs are as world-changing as the internet, that is a very, very high bar.
They're useful certainly and won't be going away after any financial bubble bursts, whether they are so useful they need to be rammed into every facet of our lives remains to be seen.
One big difference between the internet and LLMS - people enthusiastically adopted the internet and found all sorts of uses for it. LLMs companies are mandating usage by employees and trying to force end users to use it, which seems really strange, why would they have to do that if it's so useful? They're giving it away for free at present.
The best usage I see so far (which people like, though there are problems) is to replace search, so it certainly could be profitable, though it would require google-like infrastructure as google isn't going to offer those search results for free to bots forever.
Which is very typical. It's one thing to recognize a bubble; it's another to predict when it's going to pop.
There were lots of traders who lost a lot of money betting against the housing bubble pop in 2005. The bubble was front page news on the Economist in 2005. Michael Burry made a lot of money because it took him a couple of years to assemble the money to be able to bet against the market and so he got lucky on the timing.
Or as the aphorism goes: the market can stay irrational longer than you can stay solvent.
Isn't there a bit of popular wisdom that goes like this? "If you want to time the market you have to get two bets almost perfectly right. When to get out and when to get back in"
The share price slide happened before the resignation. Uncertainty, sure, but if the only change were that Jensen had not yet resigned as of today, that uncertainty would still not be resolved.
The story of the affair(s) and the Chinese spy were, yes. My point is that those stories and uncertainty seemed to have done most of the share price damage so far. The actual act of pushing out Jensen resolved some of that uncertainty. If everything had played out the same but the board had not pushed him to resign, I'm not sure things would be resolved any better currently or in the near future.
Of course, you’re describing risk. Which is how players in the markets make investment decisions. Nvidia are now a more risky investment, until proven otherwise.
The markets saw Nvidia as an increasing risk before the actual decision to fire him, so that doesn't seem to be the single incident causing uncertainty. That risk and uncertainty already existed whether or not he resigned or was fired.
People have claimed that competitors are catching up for a long time. But these journalists never understood why Nvidia was so dominant. And it seems they still don't. The Jensen story only made investors unhappy because of the high volatility and uncertainty. Noone who's well informed dumped Nvidia because of technological fears of competitors.
OTOH developers keep confusing R&D vs production. Nvidia is going to keep its dominance in R&D. But the vast majority of Nvidia chips are used for training and inference. Using Nvidia for that saves you 3 days of work porting from R&D to production.
It’s over if they don’t put a technocrat in charge a bean counter isn’t gonna keep them on top. See Apple when Jobs was fired or the clown lineup of bean counters at Intel Intel…
Nvidia biggest problem going forward they aren’t as versatile now essentially a one trick pony and now that they don’t have their CEO, they will be rudderless. That latest team up with Microsoft was a dud and a bean counter CEO isn’t gonna be able to fix that.
To be fair, ram really is cyclical, and a commodity.
The Nvidia ecosystem… not so much. Most all of these pieces fail to recognise their already dominant position in the edge inference space - and most all of these pieces fall into the trap of AI=LLMs=ChatBots, and really, who wants to chat with a computer any more.
I don’t mind. This has been a great week to stock up on the equity, and there was enough blood in the water before the salacious spy sex story that I bought a bunch of very, very cheap $150 puts, as hysterical overreaction is the plat du jour, which I sold on Thursday.
Polymarket says 7% and hasn't budged at all. Jensen looks like he will be returning as well, turns out it was just a coordinated attack from the media.
There's a simpler explanation for the stock price drop here. The price had almost gone up 5x in five years, and bad news caused people to stop and take profits. You don't have to assume their business model is bullshit or that the AI bubble is popping or that there is fraud to justify a 10% pull back after a run up like that.
There's so much projection and wishful thinking about completely normal price movements in hyped stock.
> You don't have to assume … that the AI bubble is popping
I’m not saying it is, but what is a bubble popping, if not a bunch of people saying “oh this might be the highest we go for now, I’m gonna take my profits”, which causes downward pressure for those who come slightly later who also want to take profits, etc?
The question is just if enough people stop to take profits to trigger that chain reaction. After all, it’s basically the same as saying that the seller thinks the current value in cash is more valuable than the future value of the company, otherwise people don’t really sell
Well, I don't have a subscription to Wired, so it would seem I can't read this, but the lesson I draw from this is that no one person should be so important to your company's value that them making human mistakes drags the stock value down that much. No single human is that smart or that valuable. It's the job of boards to prepare for eventualities like this. Nvidia was in a better position than most to be able to do something about Huang's conduct, but now they're having to make up a succession plan as they go along.
If you own shares in a company like that, you need to evaluate how that can be changed - either your ownership of the shares, or the corporate governance of the company.
Well before any of this happened one report that ranked boards of large publicly traded companies had NVIDIA’s board 609th out of 650 or so, by far the weakest out of peer companies. Their board tenure is more than twice as long as comparable companies (which is not a good thing), and the members do seem to cater towards Huang - such as one of his mentors being on it, who also owns a company being shoveled billions by NVIDIA.
I don’t think the report and rankings should be taken as gospel but it’s an interesting read to consider given the clear failures of the board.
> It's the job of boards to prepare for eventualities like this.
The board is the one who ousted him! I agree that they should have been better prepared, but from the outside this looks like a long-running power struggle. Jensen didn't accidentally wind up with 60 reports. The board finally found an opportunity to correct the issue.
To me, this smacks of having to cater to Huang's desire to be the "special boy". The board had actual power over him (a thing that many founders have unfortunately learned since to avoid) but at the same time, they never actually made him sit down and set up a succession plan, and never set up a board president/chairman until last week.
If they had forced him to do either of those things, it might have suggested that he was... replaceable.
And here I thought the lesson was control 51% of the vote like Zuckerberg, Karp, and Musk do, before letting your freaky flag fly.
But as this situation evolves, the spying allegations were BS which is why nothing moved on it for a year, and it looks like they need him back to manage Asia in exchange for tweaking the org chart and coming up with a succession plan. That org chart that led to his shenanigans is the same one that let him adapt faster to the moving target of AI than any of his peers. Good luck figuring out the best path forward here.
Shorting is really really hard. And the end goal of shorting, sure for someone it's self enrichment, but why it's tolerated as a whole is to help identify and pop bubbles before they get out of hand.
Journalists plausibly have the same goal: speak truth to power to protect society. To be an investigative reporter you take on immense amounts of personal risk, and on very rare occasions get a big payoff in terms of recognition and career prestige.
So Wired is "short" Nvidia only in the sense that they benefit from pointing out its problems, and mostly only if they are right and get the timing right, otherwise they just lose status.
It's a legal shield to insulate the real people from having their personal lives destroyed in court; they were just following orders type thing.
I never said shorting was easy; don't put words in others mouths.
Doesn't stop people from trying. This forum is naive af about a the world; there are billions of people who don't know you exist making choices that, like a spider-web, shake the various social webs of people and impact you.
They won't be fitting into your absurd reductionist take on human behavior.
// what exactly does the article mean with "The Jensen Mess"?
He facilitated a massive circumvention of a strategic export ban to China and played a key role in their ability to distill IP and Advantage from the US AI Companies.
His major gaffe was allowing the public a view behind the curtain to see Oz as human and fallible - and thus the custodian of $2 Trillion of market worth as unsafe. Vitalik Buterin ain't ever falling for a honeypot by comparison.
> He facilitated a massive circumvention of a strategic export ban
This lacks an "allegedly".
For now, even if I also believe that it is very likely that he facilitated a circumvention of the export ban, because that would have been profitable for NVIDIA, no evidence whatsoever has been presented publicly to support this, only pure speculation.
> Why do we have to pay more because of these gangster companies?
This is the free market; demand is high and supply is limited so price goes up. Don't like it? Start making your own and benefit from the higher prices!
This mindset has its flaws now as it often does. It is a high tech, high barrier field, so it is unlikely for companies to just pop up. Because of the scope of creating something that could rival Nvidia, it is risky and thus you will also not get many investors.
So, you will not have money and you are going into a field with big competition where all you have to go on is "well, I surely could do better." Not impossible, but that takes existing establishment in the field. You are not going to see mom and pop chip companies. Not without some major breakthrough that sets them apart.
It’s very likely the limited supply has been exaggerated deliberately by NVIDIA. That’s the whole point of the circular financing scheme they’ve developed over the past 3+ years
No, it's wearing the free market's corpse as a face. The incentives and mechanisms are perverted and investigations into things like price fixing are being launched though.
> This is the free market; demand is high and supply is limited so price goes up.
Free markets can be abused. Demand, in NVIDIA's case, seems to be not all that Jensen, and the company, had been stating. If the core demand was AI companies that were being funded by NVIDIA itself - then it wasn't organic demand.
If "... at least $200 billion worth of NVIDIA AI GPUs are sitting idle in warehouses after being purchased by cloud giants that lacked either the electrical grid capacity or immediate end-user demand to power them on" [0] is true then the demand wasn't there. There's zero reason to pre-purchase a GPU a year, even 6 months, ahead of build. Sure, maybe Google / Amazon / SpaceX buy during build - but these companies actually build their DCs, they don't buy GPUs and store them in a warehouse for quarters on end unless something went wrong (maybe like in Finland [1]). Jensen may very well be in a lot deeper than anyone really knows. The reporting as of late has stated that commitments by NVIDIA to memory suppliers was coming in and there was likely not enough non-circular capital to cover. The reality is Jensen likely thought he was going to be the AI kingpin, having a piece of all the AI pie and that he'd have enough time to recoup his ponzi-like investments in the downstream by paying for his own products.
I, personally, don't think we've even seen the start of this story. It's probably a huge mess starting with Jensen and flowing down through his kids. I can't imagine everything was on the up and up given the scale of dollars involved. It almost feels like the affair was a scapegoat to get out of the hot seat. Ultimately time will tell.
But, TL;DR - if you think the demand for NVIDIA was completely organic, well then I have a crate of Founder's Edition 5090's to sell you for dirt cheap.
> at least $200 billion worth of NVIDIA AI GPUs are sitting idle in warehouses after being purchased by cloud giants that lacked either the electrical grid capacity
People I know with adequate space and power have also heard these rumors and have looked high and low for parties with these billions worth of idle GPUs-- either to purchase their hardware or offer them hosting-- and cannot find them.
I think people are just making this up. If I'm wrong and you know someone in need, let me know and I can connect them with someone with 2GW+ of capacity.
I'm unsure about the energy efficiency of Tenstorrent cards, but they are at the moment much more cost effective than Nvidia. But software support is far behind, I suspect if it wasn't the cost would be more equal.
Already these are run on different hardware, at least as I understand, and the computational needs could further drive differentiation.
Within Google itself the TPUs are definitely preferred for AI workloads, you just can't always get them.
The writing was on the wall for TSMC ever since the 5nm node; Apple proved that anyone with enough liquid cash could block competitors from fab access.
Inference has already been commoditised.
https://d1.awsstatic.com/onedam/marketing-channels/website/a...
But the next gen of Tenstorrent HW looks great on paper - problem is, I could have written that before the current gen was released.
All of the allegedly competing HW looks like that and has looked like that for years, either a lack of availability, capability, or both.
Some suck. Google's Tensor is an example of one that doesn't, that some consider superior to Nvidia's offering. There are likely others.
one in the "Cerebras" direction of ever-larger scale general purpose HPC silicon running inference workloads. Cerebras may have skipped ahead to the last act of that scaling story, notwithstanding any further wafer-diameter enlargements past 300mm. Whether the ending is happy or not is still unclear. Lot of iterative room to grow into it further and they have a formidable patent moat waiting for conventional die-sized AI semi vendors when they inevitably run up against limitations of single-die designs.
the other is in the "Taalas" direction of freezing a specific model into something like high speed ROM / FPGA and getting orders of magnitude inference speed improvements - for that specific model. Like Cerebras, Taalas may also have jumped directly to the architectural telos of that philosophy, with only iterative improvements in cost per work unit left to grind, though like CBRS quite a lot of grinding left to do especially in getting cost per custom tapeout down to near-disposable (hopefully, recyclable) levels.
Bitcoin was lucky for Nvida, then AI was lucky. Third times the charm?
On other hand, luck favors the prepared. Beyond luck, they did make their chips accessible, easier to program than other GPU's. So bitcoin miners and then AI could utilize them.
There are still a lot of people that want to run regular liner algebra.
https://chatjimmy.ai/
those Asics have a fixed algorithm
Cerebras already does that an need to make a new chip for each new model
that's why you couldn't make an ASIC for Ethereum
Ethereum's work function was designed to be memory bandwidth limited, which is something gous are already quite well optimised for. An asic would be faster but not by enough to be worth the investment, at least while gpu margins were less crazy.
The main thing is the actual number crunching and memory interfaces for LLMs are not crazy hard to implement, and the potential scale is huge, so NVIDIA's moat is not likely to be big enough to make their current margins sustainable in the longer run.
I'm kinda bewildered, it's bizarre seeing people cheer on quickly-obsolete accelerators instead of demanding their OEM to adopt GPGPU. CUDA will be relevant for much longer than any ASIC can ever be, even (or especially) if the transformer gets replaced overnight with a better architecture.
That said, Nvidia is in a strong position.
Even in a slowdown, they probably would do ok.
All the stuff about Jensen's affairs, NVidia sales to China, circular financing, increasing competition in the market, etc. was known months ago. Indeed, much of it came out in research notes by major short-selling funds. And NVDA is an extremely attractive target for shorts, having been bid up high by the AI bubble and then having a lot of retail interest that could easily be pushed the other way. Entirely possible that certain funds have taken a large short interest and are now trying to give it that push to profit.
It's peak delusion to think that AI is going away.
AI will not crash, but, a slowdown in AI could very well cause a general recession, precisely because it's he only thing holding the economy up.
That's a totally different thing though.
Even if it's not going away, it'll be a breath of fresh air when it's not shoved into every possible place as a marketing tactic, even when it's not necessary or beneficial. AI does have it's place, I just hope we realize soon how every place is not that place.
Just because LLMs are useful doesn't mean it will have a trillion dollar evaluation.
An economy built on a lie sooner or later crashes into the reality. The sooner the less damage it will cause.
They're useful certainly and won't be going away after any financial bubble bursts, whether they are so useful they need to be rammed into every facet of our lives remains to be seen.
One big difference between the internet and LLMS - people enthusiastically adopted the internet and found all sorts of uses for it. LLMs companies are mandating usage by employees and trying to force end users to use it, which seems really strange, why would they have to do that if it's so useful? They're giving it away for free at present.
The best usage I see so far (which people like, though there are problems) is to replace search, so it certainly could be profitable, though it would require google-like infrastructure as google isn't going to offer those search results for free to bots forever.
There were lots of traders who lost a lot of money betting against the housing bubble pop in 2005. The bubble was front page news on the Economist in 2005. Michael Burry made a lot of money because it took him a couple of years to assemble the money to be able to bet against the market and so he got lucky on the timing.
Or as the aphorism goes: the market can stay irrational longer than you can stay solvent.
I guess they mean Groq. Anyone know what nvidia did with groq btw?
It's forward P/E has been well below market average for a while now.
Also for Nvidia, when a stock reaches number one and gets up to a few trillion market cap, there is hesitancy, same happened to Apple at times.
https://www.reddit.com/r/NvidiaStock/comments/1xvefbv/before...
The Nvidia ecosystem… not so much. Most all of these pieces fail to recognise their already dominant position in the edge inference space - and most all of these pieces fall into the trap of AI=LLMs=ChatBots, and really, who wants to chat with a computer any more.
I don’t mind. This has been a great week to stock up on the equity, and there was enough blood in the water before the salacious spy sex story that I bought a bunch of very, very cheap $150 puts, as hysterical overreaction is the plat du jour, which I sold on Thursday.
Internet: The end is near! The market is collapsing.
Investors: Well I was up 100% but now I'm up 80%.
That's bad math. If you had 100k invested, and you're up 100%, then you were at 200k. A 20% drop leaves you with 160k, and you're only up 60%.
But oh no, whatever shall I do. Oh, I’ll hold. That’s what I’ll do.
The press is hot trash. The financial press doubly so.
There's so much projection and wishful thinking about completely normal price movements in hyped stock.
> You don't have to assume … that the AI bubble is popping
I’m not saying it is, but what is a bubble popping, if not a bunch of people saying “oh this might be the highest we go for now, I’m gonna take my profits”, which causes downward pressure for those who come slightly later who also want to take profits, etc?
The question is just if enough people stop to take profits to trigger that chain reaction. After all, it’s basically the same as saying that the seller thinks the current value in cash is more valuable than the future value of the company, otherwise people don’t really sell
If you own shares in a company like that, you need to evaluate how that can be changed - either your ownership of the shares, or the corporate governance of the company.
I don’t think the report and rankings should be taken as gospel but it’s an interesting read to consider given the clear failures of the board.
https://jdrurypartners.com/news/weight-of-americas-boards-20...
The board is the one who ousted him! I agree that they should have been better prepared, but from the outside this looks like a long-running power struggle. Jensen didn't accidentally wind up with 60 reports. The board finally found an opportunity to correct the issue.
If they had forced him to do either of those things, it might have suggested that he was... replaceable.
But as this situation evolves, the spying allegations were BS which is why nothing moved on it for a year, and it looks like they need him back to manage Asia in exchange for tweaking the org chart and coming up with a succession plan. That org chart that led to his shenanigans is the same one that let him adapt faster to the moving target of AI than any of his peers. Good luck figuring out the best path forward here.
Not saying this author does. But senior leadership at Wired?
Everyone just using an obfuscated form of Elon's "GAMESTONK" strategy to boost their position.
Journalists plausibly have the same goal: speak truth to power to protect society. To be an investigative reporter you take on immense amounts of personal risk, and on very rare occasions get a big payoff in terms of recognition and career prestige.
So Wired is "short" Nvidia only in the sense that they benefit from pointing out its problems, and mostly only if they are right and get the timing right, otherwise they just lose status.
It's a legal shield to insulate the real people from having their personal lives destroyed in court; they were just following orders type thing.
I never said shorting was easy; don't put words in others mouths.
Doesn't stop people from trying. This forum is naive af about a the world; there are billions of people who don't know you exist making choices that, like a spider-web, shake the various social webs of people and impact you.
They won't be fitting into your absurd reductionist take on human behavior.
Disgusting.
Because they're being supplied with the means to realise the Panopticon.
GCHQ in particular are chomping at the bit to be able to utilise all that lovely mass-data gathering they pulled from their fibre taps into Europe.
https://en.wikipedia.org/wiki/Tempora
// what exactly does the article mean with "The Jensen Mess"?
He facilitated a massive circumvention of a strategic export ban to China and played a key role in their ability to distill IP and Advantage from the US AI Companies.
His major gaffe was allowing the public a view behind the curtain to see Oz as human and fallible - and thus the custodian of $2 Trillion of market worth as unsafe. Vitalik Buterin ain't ever falling for a honeypot by comparison.
This lacks an "allegedly".
For now, even if I also believe that it is very likely that he facilitated a circumvention of the export ban, because that would have been profitable for NVIDIA, no evidence whatsoever has been presented publicly to support this, only pure speculation.
This is the free market; demand is high and supply is limited so price goes up. Don't like it? Start making your own and benefit from the higher prices!
So, you will not have money and you are going into a field with big competition where all you have to go on is "well, I surely could do better." Not impossible, but that takes existing establishment in the field. You are not going to see mom and pop chip companies. Not without some major breakthrough that sets them apart.
I use Apple and AMD chips for desktop inference. nVidia is still cheaper for anything beyond that.
Free markets can be abused. Demand, in NVIDIA's case, seems to be not all that Jensen, and the company, had been stating. If the core demand was AI companies that were being funded by NVIDIA itself - then it wasn't organic demand.
If "... at least $200 billion worth of NVIDIA AI GPUs are sitting idle in warehouses after being purchased by cloud giants that lacked either the electrical grid capacity or immediate end-user demand to power them on" [0] is true then the demand wasn't there. There's zero reason to pre-purchase a GPU a year, even 6 months, ahead of build. Sure, maybe Google / Amazon / SpaceX buy during build - but these companies actually build their DCs, they don't buy GPUs and store them in a warehouse for quarters on end unless something went wrong (maybe like in Finland [1]). Jensen may very well be in a lot deeper than anyone really knows. The reporting as of late has stated that commitments by NVIDIA to memory suppliers was coming in and there was likely not enough non-circular capital to cover. The reality is Jensen likely thought he was going to be the AI kingpin, having a piece of all the AI pie and that he'd have enough time to recoup his ponzi-like investments in the downstream by paying for his own products.
I, personally, don't think we've even seen the start of this story. It's probably a huge mess starting with Jensen and flowing down through his kids. I can't imagine everything was on the up and up given the scale of dollars involved. It almost feels like the affair was a scapegoat to get out of the hot seat. Ultimately time will tell.
But, TL;DR - if you think the demand for NVIDIA was completely organic, well then I have a crate of Founder's Edition 5090's to sell you for dirt cheap.
[0] https://wccftech.com/jensen-huang-financed-ai-startups-absor... [1] https://www.reuters.com/business/environment/finland-launche...
People I know with adequate space and power have also heard these rumors and have looked high and low for parties with these billions worth of idle GPUs-- either to purchase their hardware or offer them hosting-- and cannot find them.
I think people are just making this up. If I'm wrong and you know someone in need, let me know and I can connect them with someone with 2GW+ of capacity.