The Japan Times - AI chip crunch: startups vie for Nvidia's vital component

EUR -
AED 3.844238
AFN 75.880395
ALL 98.749439
AMD 412.263151
ANG 1.885803
AOA 959.757118
ARS 1109.566323
AUD 1.649092
AWG 1.886546
AZN 1.767228
BAM 1.954908
BBD 2.112695
BDT 127.130759
BGN 1.954373
BHD 0.394407
BIF 3098.985533
BMD 1.046627
BND 1.400061
BOB 7.245762
BRL 6.04647
BSD 1.046402
BTN 90.692006
BWP 14.413559
BYN 3.424239
BYR 20513.894863
BZD 2.101841
CAD 1.492862
CDF 3005.914039
CHF 0.939175
CLF 0.025742
CLP 987.837869
CNY 7.586054
CNH 7.59259
COP 4306.79803
CRC 529.848037
CUC 1.046627
CUP 27.735623
CVE 110.680547
CZK 24.986866
DJF 186.006878
DKK 7.460139
DOP 65.313005
DZD 141.199936
EGP 52.953934
ERN 15.699409
ETB 132.686197
FJD 2.404416
FKP 0.828444
GBP 0.829143
GEL 2.946215
GGP 0.828444
GHS 16.259352
GIP 0.828444
GMD 74.832671
GNF 9059.606055
GTQ 8.076275
GYD 218.922169
HKD 8.13758
HNL 26.901862
HRK 7.535925
HTG 137.25473
HUF 401.294168
IDR 17049.71553
ILS 3.74452
IMP 0.828444
INR 90.689939
IQD 1371.081748
IRR 44076.095287
ISK 145.010368
JEP 0.828444
JMD 165.023102
JOD 0.742579
JPY 156.738196
KES 135.530798
KGS 91.527781
KHR 4205.348214
KMF 491.522363
KPW 941.96456
KRW 1496.279019
KWD 0.322843
KYD 0.87201
KZT 523.256172
LAK 22711.811979
LBP 93725.474221
LKR 309.342896
LRD 207.494097
LSL 19.237373
LTL 3.090418
LVL 0.633094
LYD 5.102339
MAD 10.40663
MDL 19.489291
MGA 4892.63757
MKD 61.536016
MMK 2197.892327
MNT 3624.010479
MOP 8.378856
MRU 42.032084
MUR 48.406778
MVR 16.06578
MWK 1811.711721
MXN 21.422488
MYR 4.618246
MZN 66.889726
NAD 19.237123
NGN 1571.898582
NIO 38.473873
NOK 11.64993
NPR 145.109688
NZD 1.826053
OMR 0.402951
PAB 1.046422
PEN 3.854729
PGK 4.2009
PHP 60.582456
PKR 292.618578
PLN 4.144864
PYG 8264.07012
QAR 3.810508
RON 4.978495
RSD 117.199211
RUB 91.841953
RWF 1465.278204
SAR 3.92489
SBD 8.833531
SCR 15.478477
SDG 629.022853
SEK 11.162505
SGD 1.401863
SHP 0.831677
SLE 24.009606
SLL 21947.256836
SOS 598.166615
SRD 37.10451
STD 21663.071748
SVC 9.155821
SYP 13608.170728
SZL 19.237005
THB 35.083304
TJS 11.405603
TMT 3.673662
TND 3.315192
TOP 2.451309
TRY 38.132297
TTD 7.105553
TWD 34.262284
TZS 2704.484809
UAH 43.70101
UGX 3846.226096
USD 1.046627
UYU 45.139397
UZS 13513.004455
VES 66.370288
VND 26657.597049
VUV 128.627224
WST 2.930883
XAF 655.657739
XAG 0.032382
XAU 0.000355
XCD 2.828562
XDR 0.797025
XOF 653.095813
XPF 119.331742
YER 258.909449
ZAR 19.242768
ZMK 9420.905718
ZMW 29.533802
ZWL 337.01356
  • CMSC

    0.0500

    23.42

    +0.21%

  • CMSD

    0.0400

    23.46

    +0.17%

  • JRI

    0.0100

    12.81

    +0.08%

  • BCE

    0.1100

    24.08

    +0.46%

  • RBGPF

    0.5700

    65.42

    +0.87%

  • BCC

    -3.1000

    103.69

    -2.99%

  • RIO

    -0.7900

    62.74

    -1.26%

  • NGG

    0.8800

    62.19

    +1.42%

  • SCS

    0.0100

    12.32

    +0.08%

  • GSK

    0.4400

    37.08

    +1.19%

  • BTI

    0.2400

    38.09

    +0.63%

  • RELX

    -0.1000

    49.19

    -0.2%

  • VOD

    0.2200

    8.58

    +2.56%

  • RYCEF

    -0.0300

    7.67

    -0.39%

  • BP

    -0.1500

    33.74

    -0.44%

  • AZN

    0.4700

    74.69

    +0.63%

AI chip crunch: startups vie for Nvidia's vital component
AI chip crunch: startups vie for Nvidia's vital component / Photo: JUSTIN SULLIVAN - GETTY IMAGES NORTH AMERICA/AFP/File

AI chip crunch: startups vie for Nvidia's vital component

The artificial intelligence revolution is fully underway, but soaring demand for its most crucial component has startups scratching their heads on how they can deliver on AI's promise.

Text size:

Generative AI's lifeblood is a book-sized semiconductor known as the graphics processing unit (GPU) -- built by one company, Nvidia.

Nvidia's CEO and founder Jensen Huang made a wild bet years ago that the world would soon clamor for a powerful chip usually used for making video games, but that could build AI as well.

No company working with the generative AI models that fuel today's frenzy can get off the ground without Nvidia's singular product: the latest model is the H100 and its accompanying software.

That painful reality is one that Amazon, Intel, AMD and others are scrambling to fix with their own alternatives, but those attempts could take years.

- 'Not a lot of GPUs' -

And with the biggest tech companies throwing all their financial might into generative AI, the smaller fish must go on the hunt to secure Nvidia’s holy grail.

"Around the world, it is becoming very hard to get thousands of GPUs because all these big companies are putting in billions of dollars, stockpiling GPUs," said Fangbo Tao, co-founder of Mindverse.AI, a Singapore-based startup.

"There's not a lot of GPUs around," he said.

Tao spoke to AFP at the TechCrunch Disrupt conference in San Francisco, where AI startups jostled to make their pitches to Silicon Valley's venture capitalists (VC).

ChatGPT took the world by storm just as Silicon Valley was caught in a nasty hangover from the pandemic when investors threw money at startups, convinced that life had gone irreversibly online.

That turned out to be far-fetched, and the US tech scene entered a downturn with rounds of layoffs and VC money dried up.

Thanks to AI, some of the old mojo is back, and anyone with those two letters on their resume will likely see a red carpet rolled out on the legendary Sand Hill Road, home to Silicon Valley’s most storied investors.

But as the startups walk away with their VC cash, the money in their pockets will be quickly forked out to Nvidia for GPUs either directly or through providers to bring their AI dreams to execution.

"We call on a lot of the big cloud providers (Microsoft, AWS and Google) ), and they all tell us even they are having trouble getting supplies," said Laurent Daudet, CEO of AI startup LightOn.

The problem is most acute for companies involved in training generative AI models, which requires that power hungry GPUs work at peak capacity to process troves of data ingested from the internet.

The computing needs are so massive that only a few companies can stump up the cash to build one of these state-of-the-art large language models.

- 'Sucking the oxygen' -

The ten billion dollars investment by Microsoft into OpenAI is widely understood to be paid out as credits to access purpose-built data centers humming with Nvidia GPUs.

Google has built its own models and now Amazon on Monday said it was pumping four billion dollars into Anthropic AI, another company that trains AI.

Training on that mountain of data "is sucking out almost all the oxygen from the GPU market right now," said Said Ouissal, CEO of Zededa, a company that works on making AI less power hungry.

"You're looking at mid-next year, maybe late next year before you're actually going to get delivery on new orders. The shortage doesn't seem to be letting up," added Wes Cummins, CEO Applied Digital, a company that supplies AI infrastructure.

Companies on the AI frontlines also point out that Nvidia’s primordial role makes it the de-facto kingmaker on where the technology is going.

The market is "almost entirely driven by the big players -- Googles, Amazons, Metas" that have the "enormous amounts of data and enormous amounts of capital," former Nvidia engineer Jacopo Pantaleoni told The Information.

"This was not the world I wanted to help build," he said.

Some veterans of Silicon Valley said that the frenzied days of Nvidia GPUs will not last forever and that other options will inevitably emerge.

Or the cost of entry will prove too high, even for the giants, bringing the current boom down to earth.

M.Ito--JT