Skip to content
Artificial intelligence. Clearly. RSS feed
AI NEWS AI

News. Evidence. Perspective.

FuriosaAI Raises $620 Million to Make Inference Chips a Power-Budget Decision

South Korea’s FuriosaAI says its RNGD chip is in mass production and has raised $620 million at a $2.9 billion post-money valuation. Its claims about users per kilowatt are vendor benchmarks; the more revealing milestone is deployment outside the laboratory.

An AI chip does not have to win every benchmark to be commercially useful. It has to complete a customer's work at a price, latency and power draw that make the deployment economical. This is the proposition behind a $620 million Series D financing announced by South Korea's FuriosaAI on 28 October, at a stated post-money valuation of $2.9 billion. The company's RNGD accelerator is designed for inference: the repeated act of using trained models to produce answers, images or other outputs, rather than training the model from scratch.[1]

FuriosaAI says RNGD entered mass production in January 2026 and projects production of 20,000 accelerator cards during the year, with components reserved to more than double that volume in 2027. Those are company disclosures and production intentions; they are not a count of cards independently verified as installed and fully utilized by paying customers. Still, reaching volume manufacturing differs materially from presenting a working prototype at a trade show. Packaging, memory supply, compiler maturity and service support can be harder to scale than the silicon design itself.[1]

The card operates at a stated 180 watts and is air cooled. Eight cards form the company's proposed 4U NXT server configuration, with a quoted 3-kilowatt server power envelope, four petaFLOPS of FP8 compute and 384 gigabytes of HBM3. The card and server wattages are not contradictory: an installed system must power processors, memory, host components, networking and cooling as well as the accelerator chips. What matters in a data-centre purchasing decision is useful work per whole-system watt under the actual workload, not merely arithmetic capability per chip.[1]

The metric hidden behind the model leaderboard

Furiosa says an eight-card system can match the throughput of an equal-card-count RTX PRO 6000 configuration while serving twice as many users per kilowatt. That sounds decisive but requires an exact workload, batching policy, model, token-generation speed and precision setting to interpret. The company positions RNGD around interactive model serving at up to roughly 100 generated tokens per second per user. A server optimized for those concurrent users may behave differently on a very large model, long-context prompting or low-batch single-user latency. Buyers need side-by-side results on their own deployments.[1]

There is a legitimate technical idea underneath the numbers. Furiosa describes its Tensor Contraction Processor architecture as using higher-dimensional tensor operations together with a compiler that plans data movement across an entire model. Conventional GPU workloads often break calculations into matrix operations, with intermediate values repeatedly moving across the memory hierarchy. Reducing the cost of moving data rather than simply adding arithmetic units can matter greatly in energy-constrained inference.[1]

The company names production users, including Samsung SDS's NPU-as-a-Service offering and LG Group businesses deploying on-premises or hybrid cloud environments. These are meaningful customer references, though the announcement does not disclose their total spending, fleet utilization, support incidents or the degree of software migration required. An inference chip sold without dependable model tooling is effectively a computer customers cannot readily program.[1]

In detail

What FuriosaAI has reported—and what it has not

What FuriosaAI has reported—and what it has not
Measure or questionWhat the evidence says
Series D$620 million raised; $2.9 billion post-money valuation, company announcementSource 1
Current card180 W, air-cooled RNGD PCIe acceleratorSource 1
NXT server8 cards; stated 3 kW whole-server envelope; 384 GB HBM3Source 1
ProductionRNGD mass-production claim; target of 20,000 cards in 2026Source 1
EfficiencyTwice as many users per kilowatt versus specified comparison, company benchmarkSource 1
Next generation2 nm multi-die and HBM4/4E: development roadmap, not shipping performanceSource 1

Investment is not automatically evidence of product economics

The financing brings hardware scale-up risk to the foreground. Furiosa identifies investor participation from, among others, Cisco Investments and Korean financial institutions, with an approximately $280 million commitment attributed to Korea's National Growth Fund. The mix of international and national capital signals confidence in non-GPU compute supply, but neither funding amount nor valuation establishes an advantage in delivered price per million tokens.[1]

Furiosa also sketches a third-generation design being developed with Broadcom and partners, using a 2-nanometre multi-die approach and HBM4/4E memory. These are roadmap features, not deployed product specifications. Building a new chip takes time; every software release changes which models and batching methods the current chip can run efficiently. The company says a recent SDK revision improved tokens per watt on 18 models, including a 138% increase on gpt-oss-120B relative to its previous SDK. That is an internal before-and-after software comparison, not a 138% lead over a rival chip.[1]

Why the result matters beyond Furiosa

GPU scarcity and electricity constraints create openings for narrower, well-supported accelerators. Enterprises may be willing to trade generality for stable, efficient serving of a defined model portfolio. They may also be reluctant to make that trade if it creates a new proprietary programming dependency. The next compelling evidence will be repeat customers, transparent total-cost-of-ownership comparisons and reliable operation over many months. Inference has become a market for entire working systems, not just fast chips. That is what Furiosa's financing now has to prove.[1]

Follow the evidence

Sources & further reading