Frontiers of compute: how to reduce AI inference costs

By McKinsey & Company.

This email, sent by Bill Wiseman and Marc de Jong, global leaders of McKinsey's Semiconductors practice, announces a new article titled "Frontiers of compute: The technologies to reduce AI inference costs".

The central message previewed in the email is brief but forceful: AI's next big breakthrough may not be a smarter model, but a cheaper token. In other words, the article focuses on technologies that make inference (the process of running an already-trained model to generate responses) cheaper, as opposed to the usual emphasis on training ever-larger models.

The body of the email does not elaborate on which specific technologies are covered in the full article; it simply presents the headline, the hook line, and links to the main piece along with two suggested related articles under "Also Consider": "The next era of semiconductor value creation" and "Where AI will create value—and where it won't".

More broadly, as industry context, reducing inference costs is a topic of growing strategic importance for the semiconductor industry and agentic AI, since the large-scale deployment of agents and LLM-based applications depends heavily on the cost per inference token continuing to fall, which directly affects the economic viability of scaling these systems in production.