Technology

Astra Ultrafast is a speed claim. The bill is still yours.

NVIDIA’s October 1 post says GPT-6 Astra Ultrafast runs on its GPUs, up to 8x faster. The blog says that 8x is against Astra Standard, on token generation, for agents that write, call a tool, and try again.

Rows of equipment in a data center
Faster tokens are still a line on somebody’s invoice. Photo: Circuit & Capital

NVIDIA’s account posted it on October 1: up to 8x faster, and GPT-6 Astra Ultrafast runs on NVIDIA. The post points at a company blog. The blog, by Dion Harris and dated the same day, is the specification. It says Ultrafast is available now in the OpenAI API and to eligible ChatGPT Work and Codex users. It runs on Blackwell GPUs. OpenAI’s inference optimizations use that architecture. Against Astra Standard mode, NVIDIA says Ultrafast offers up to 8x faster token generation.

Read the “up to.” It is NVIDIA’s comparison, on NVIDIA’s page, against one other mode of the same model family. It is not a measurement this desk has repeated, and it is not a promise that your coding agent will finish a workday eight times sooner. Faster token generation matters in a loop. It does not retire the loop.

Where they say the speed shows up

The blog names three places: code generation, tool use, and interactive applications. The operator sentence is the next one. A faster response matters most when it is repeated. An agent writes code, uses a tool, checks the result, and decides what to do next. Ultrafast is pitched as Astra inside that cycle: shorter edit-test-debug runs, less time between tool calls, applications that feel more responsive.

Philippe Tillet, identified as inference lead at OpenAI, is quoted saying NVIDIA’s tooling let OpenAI’s models get “exceptionally good at programming Blackwell and Rubin GPUs,” and that Astra can turn that into kernels across latency, throughput, and cost. The product described as available is Ultrafast on Blackwell. Rubin is in the quote as hardware the model can program. Do not brief a board that Ultrafast “runs on Rubin” off that sentence.

Uday Ruddarraju, identified as chief technology officer of compute at OpenAI, says OpenAI used its internal models to optimize inference on NVIDIA GPUs, and that NVIDIA’s programmability helped deliver the acceleration. A later section says the gains do not stop at deployment. OpenAI is using its own models to keep refining the inference software, and a programmable platform is supposed to let the same machines move across training, inference, and reinforcement learning so teams are not overbuilding for one workload.

An agent that finishes the wrong tool call faster has not saved the afternoon. It has spent it sooner.

What the post does not settle

Price is not in the blog post this briefing uses. The page sends developers to OpenAI’s Ultrafast guide for access, pricing, and implementation. That guide is the page that answers “what does a token cost,” and it can change without NVIDIA editing the blog. Quote the guide you opened, with the date you opened it. Do not quote the 8x as a discount.

Eligibility is also narrower than “ChatGPT.” The blog says the API, and eligible ChatGPT Work and Codex users. If the people who would use this are on a different plan, the announcement does not include them until that guide says so.

Gartner posted on September 24 that managing AI cost is becoming as important as deploying AI, and pointed at pricing that shifts from seats and consumption toward coding agents. The same house’s September 16 forecast still puts most of the industry bill in infrastructure, not in the seat a company renews. Ultrafast is a candidate for both lines. The chip owner hears a utilization story. The buyer of the API hears a faster agent and an unknown invoice. Put them in different cells. The forecast note is Gartner revised the AI bill. Check the speed line in the vendor claim checker, and the price in token cost to gross margin. The worksheet is Put an AI cost on one workflow.

The same month already asked who may touch the tools

Three days before this speed post, NVIDIA launched the Open Agent Safety Platform. OpenShell is the open-source runtime that is supposed to enforce permissions. Sentry is the BlueField watchdog. The failure they described was an agent getting around application-layer controls to finish its task. Ultrafast is aimed at the same shape of work: an agent, a tool, another step. A faster loop makes a missing permission more expensive, not less. The write-up is NVIDIA put the fence outside the agent. The sheet is the agent access limit sheet. The question list is Limit what an agent can touch.

Ask four things before anyone turns the mode on for a team. Which workflow repeats often enough that token time is actually the wait. Whether those calls can spend money, send mail, or change a record. What the Ultrafast guide says the price is on the day you switch. And who can turn it off if the loop gets quicker and worse. The 8x stays NVIDIA’s claim until someone you trust times your own workflow.

Sources

Related: NVIDIA put the fence outside the agent, the vendor claim checker, and Put an AI cost on one workflow.

ES
Emilio Santos writes and edits every piece on Circuit & Capital.