DeepSeek open sources DSpark, a new framework to speed up LLM inference by up to 85%

DSpark can make decoding faster, but acceptance quality still determines how much speed the system actually realizes.
VentureBeat

The new open-source AI full-stack platform challenging OpenAI (and supporting LLaMA 2)

Join the event trusted by enterprise leaders for nearly two decades. VB Transform brings together the people building real enterprise AI strategy. Learn more Yesterday’s release of Meta’s LLaMA 2, ...
SDxCentral

Meta open-sources transport stack to scale AI training to over 100K GPUs

Meta has open-sourced CTran, the tech giant’s custom transport stack used to perform in-house optimizations. Detailed in a PyTorch blog post, first picked up by SemiAnalysis, CTran contains multiple ...
Business Wire

Predibase Launches Next-Gen Inference Stack for Faster, Cost-Effective Small Language Model Serving

Predibase's Inference Engine Harnesses LoRAX, Turbo LoRA, and Autoscaling GPUs to 3-4x Throughput and Cut Costs by Over 50% While Ensuring Reliability for High Volume Enterprise Workloads. SAN ...
SDxCentral

AI inferencing will define 2026, and the market's wide open

“I get asked all the time what I think about training versus inference – I'm telling you all to stop talking about training versus inference.” So declared OpenAI VP Peter Hoeschele at Oracle’s AI ...
Tech Times

OpenAI Halves Inference Costs With Software Alone: GPUs Drop to Hundreds

OpenAI inference cost reduction cut ChatGPT guest traffic from tens of thousands of Nvidia GPUs to just a couple hundred, ...
DelmarvaNow

Tenstorrent Unveils TT-QuietBox(TM) 2, the First RISC-V AI Workstation With a Fully Open-Source Stack to Deliver Teraflop-Class Inference

Liquid-Cooled Desktop System Runs Models up to 120B Parameters Locally With a Fully Open-Source Stack, Starting at $9,999 SANTA CLARA, CA / ACCESS Newswire / March 11, 2026 / Tenstorrent, the AI ...
Forbes

The Rise Of The AI Inference Economy

Forbes contributors publish independent expert analyses and insights. I write about the economics of AI. When OpenAI’s ChatGPT first exploded onto the scene in late 2022, it sparked a global obsession ...
SiliconANGLE

Deepinfra lands $107M in funding to build out its dedicated inference cloud for open-source models

Dedicated inference cloud startup Deepinfra Inc. is looking to expand its global capacity after raising $107 million in a Series B round of funding led by 500 Global and Georges Harik, who was one of ...