The Japan Times - AI chip crunch: startups vie for Nvidia's vital component

EUR -
AED 3.847359
AFN 75.944909
ALL 98.829151
AMD 412.602318
ANG 1.887334
AOA 959.488828
ARS 1110.477607
AUD 1.646976
AWG 1.888077
AZN 1.777167
BAM 1.956495
BBD 2.11441
BDT 127.233958
BGN 1.955859
BHD 0.394754
BIF 3101.501139
BMD 1.047477
BND 1.401197
BOB 7.251644
BRL 6.006649
BSD 1.047252
BTN 90.765625
BWP 14.425259
BYN 3.427019
BYR 20530.547045
BZD 2.103547
CAD 1.489465
CDF 3008.35342
CHF 0.939372
CLF 0.025774
CLP 989.090745
CNY 7.592216
CNH 7.596852
COP 4309.403724
CRC 530.278142
CUC 1.047477
CUP 27.758138
CVE 110.770788
CZK 24.981291
DJF 186.158001
DKK 7.459395
DOP 65.363267
DZD 140.916817
EGP 53.04416
ERN 15.712153
ETB 133.003407
FJD 2.402545
FKP 0.829117
GBP 0.828429
GEL 2.929684
GGP 0.829117
GHS 16.175799
GIP 0.829117
GMD 75.417973
GNF 9045.187511
GTQ 8.076649
GYD 218.905754
HKD 8.143892
HNL 26.815698
HRK 7.533764
HTG 139.292673
HUF 403.690332
IDR 17116.008463
ILS 3.739508
IMP 0.829117
INR 90.720916
IQD 1372.581879
IRR 43996.768884
ISK 145.865696
JEP 0.829117
JMD 164.700677
JOD 0.74269
JPY 156.606701
KES 135.896719
KGS 91.601879
KHR 4192.002687
KMF 492.822163
KPW 942.729201
KRW 1503.052814
KWD 0.323204
KYD 0.858935
KZT 526.496912
LAK 22710.847117
LBP 93801.55579
LKR 309.723266
LRD 207.626754
LSL 19.224748
LTL 3.092927
LVL 0.633608
LYD 5.125619
MAD 10.421636
MDL 19.409746
MGA 4940.551207
MKD 61.424045
MMK 2199.676469
MNT 3626.952274
MOP 8.382933
MRU 41.736988
MUR 48.162438
MVR 16.193987
MWK 1815.623998
MXN 21.420866
MYR 4.628536
MZN 66.915649
NAD 19.224748
NGN 1570.752655
NIO 38.363106
NOK 11.6385
NPR 145.221507
NZD 1.823364
OMR 0.402969
PAB 1.047477
PEN 3.861523
PGK 4.210859
PHP 60.622746
PKR 292.748263
PLN 4.166502
PYG 8306.919848
QAR 3.81309
RON 4.983975
RSD 117.353177
RUB 92.703489
RWF 1464.713001
SAR 3.927784
SBD 8.832012
SCR 15.454623
SDG 627.346982
SEK 11.154435
SGD 1.399836
SHP 0.832352
SLE 23.819316
SLL 21965.072552
SOS 598.582151
SRD 37.174952
STD 21680.656776
SVC 9.165684
SYP 13619.217179
SZL 19.224748
THB 35.181625
TJS 11.464407
TMT 3.666169
TND 3.31
TOP 2.495808
TRY 38.165177
TTD 7.116999
TWD 34.368952
TZS 2695.618534
UAH 43.719742
UGX 3844.110105
USD 1.047477
UYU 44.896223
UZS 13543.742312
VES 66.337689
VND 26726.202845
VUV 128.731637
WST 2.933262
XAF 657.096217
XAG 0.032436
XAU 0.000356
XCD 2.828188
XDR 0.797889
XOF 657.096217
XPF 119.331742
YER 261.984398
ZAR 19.251886
ZMK 9428.548431
ZMW 29.571417
ZWL 337.287131
  • RBGPF

    0.5700

    65.42

    +0.87%

  • CMSC

    0.0800

    23.45

    +0.34%

  • RYCEF

    0.0200

    7.72

    +0.26%

  • BCC

    -0.4080

    106.382

    -0.38%

  • RELX

    0.1650

    49.455

    +0.33%

  • RIO

    -0.3100

    63.22

    -0.49%

  • NGG

    0.9170

    62.227

    +1.47%

  • CMSD

    0.0560

    23.476

    +0.24%

  • GSK

    0.3600

    37

    +0.97%

  • SCS

    0.0350

    12.345

    +0.28%

  • AZN

    0.6250

    74.845

    +0.84%

  • VOD

    0.2850

    8.645

    +3.3%

  • BCE

    0.2800

    24.25

    +1.15%

  • JRI

    0.0400

    12.84

    +0.31%

  • BTI

    0.2900

    38.14

    +0.76%

  • BP

    -0.0300

    33.86

    -0.09%

AI chip crunch: startups vie for Nvidia's vital component
AI chip crunch: startups vie for Nvidia's vital component / Photo: JUSTIN SULLIVAN - GETTY IMAGES NORTH AMERICA/AFP/File

AI chip crunch: startups vie for Nvidia's vital component

The artificial intelligence revolution is fully underway, but soaring demand for its most crucial component has startups scratching their heads on how they can deliver on AI's promise.

Text size:

Generative AI's lifeblood is a book-sized semiconductor known as the graphics processing unit (GPU) -- built by one company, Nvidia.

Nvidia's CEO and founder Jensen Huang made a wild bet years ago that the world would soon clamor for a powerful chip usually used for making video games, but that could build AI as well.

No company working with the generative AI models that fuel today's frenzy can get off the ground without Nvidia's singular product: the latest model is the H100 and its accompanying software.

That painful reality is one that Amazon, Intel, AMD and others are scrambling to fix with their own alternatives, but those attempts could take years.

- 'Not a lot of GPUs' -

And with the biggest tech companies throwing all their financial might into generative AI, the smaller fish must go on the hunt to secure Nvidia’s holy grail.

"Around the world, it is becoming very hard to get thousands of GPUs because all these big companies are putting in billions of dollars, stockpiling GPUs," said Fangbo Tao, co-founder of Mindverse.AI, a Singapore-based startup.

"There's not a lot of GPUs around," he said.

Tao spoke to AFP at the TechCrunch Disrupt conference in San Francisco, where AI startups jostled to make their pitches to Silicon Valley's venture capitalists (VC).

ChatGPT took the world by storm just as Silicon Valley was caught in a nasty hangover from the pandemic when investors threw money at startups, convinced that life had gone irreversibly online.

That turned out to be far-fetched, and the US tech scene entered a downturn with rounds of layoffs and VC money dried up.

Thanks to AI, some of the old mojo is back, and anyone with those two letters on their resume will likely see a red carpet rolled out on the legendary Sand Hill Road, home to Silicon Valley’s most storied investors.

But as the startups walk away with their VC cash, the money in their pockets will be quickly forked out to Nvidia for GPUs either directly or through providers to bring their AI dreams to execution.

"We call on a lot of the big cloud providers (Microsoft, AWS and Google) ), and they all tell us even they are having trouble getting supplies," said Laurent Daudet, CEO of AI startup LightOn.

The problem is most acute for companies involved in training generative AI models, which requires that power hungry GPUs work at peak capacity to process troves of data ingested from the internet.

The computing needs are so massive that only a few companies can stump up the cash to build one of these state-of-the-art large language models.

- 'Sucking the oxygen' -

The ten billion dollars investment by Microsoft into OpenAI is widely understood to be paid out as credits to access purpose-built data centers humming with Nvidia GPUs.

Google has built its own models and now Amazon on Monday said it was pumping four billion dollars into Anthropic AI, another company that trains AI.

Training on that mountain of data "is sucking out almost all the oxygen from the GPU market right now," said Said Ouissal, CEO of Zededa, a company that works on making AI less power hungry.

"You're looking at mid-next year, maybe late next year before you're actually going to get delivery on new orders. The shortage doesn't seem to be letting up," added Wes Cummins, CEO Applied Digital, a company that supplies AI infrastructure.

Companies on the AI frontlines also point out that Nvidia’s primordial role makes it the de-facto kingmaker on where the technology is going.

The market is "almost entirely driven by the big players -- Googles, Amazons, Metas" that have the "enormous amounts of data and enormous amounts of capital," former Nvidia engineer Jacopo Pantaleoni told The Information.

"This was not the world I wanted to help build," he said.

Some veterans of Silicon Valley said that the frenzied days of Nvidia GPUs will not last forever and that other options will inevitably emerge.

Or the cost of entry will prove too high, even for the giants, bringing the current boom down to earth.

M.Ito--JT