Facebook
Britain's News Portal
Around The Clock
BREAKING
Loading latest headlines…

Intel's Optane memory could have eased AI inference costs, analysts say

Intel discontinued its Optane memory technology in 2022, just before AI inference workloads that would have benefited from its high write endurance and low latency became widespread.

  • Intel and Micron co-developed 3D XPoint memory, branded Optane, which offered sub-10-microsecond latencies and extremely high write endurance.
  • Intel ended Optane development in 2022, the same year OpenAI launched ChatGPT, sparking an AI boom.
  • Modern AI inference relies on KV caching, a write-intensive workload for which Optane's properties would have been well suited.

Intel's Optane memory technology, discontinued in 2022, would have been ideally suited to the write-intensive AI inference workloads that emerged shortly after its demise, according to analysts.

Optane, based on 3D XPoint memory co-developed with Micron, offered sub-10-microsecond latencies and write endurance of up to 100 drive writes per day — specifications that remain unmatched today. However, the technology struggled commercially due to high pricing relative to NAND flash and was discontinued by Intel in 2022.

The same year, OpenAI launched ChatGPT, triggering a surge in AI development. The shift from training to inference has since driven demand for memory and storage, with modern inference engines caching key-value pairs to track model state — a write-heavy workload that strains conventional NAND flash.

Analysts note that Optane's endurance and low latency for small random writes would have made it a perfect choice for such caching, potentially easing the cost and supply pressures on DRAM and NAND.

Why this matters: The analysis highlights a missed opportunity: a technology that could have addressed current memory bottlenecks in AI inference was discontinued just before the workload became dominant.

What this means for you: AI services may face higher costs or performance limits due to memory constraints that Optane could have alleviated.

Related Articles

Get the news that matters.

Join thousands of readers getting the best of British news straight to their inbox.