Skip to main content
AI Strategyopen source AImodel selectioncost

The Falling Cost of AI: What Open-Weight Models Mean for Australian SMEs

AI inference is getting dramatically cheaper as open-weight models close the gap with the frontier. What the cost collapse means for Australian SMEs, and how to take advantage of it without getting the trade-offs wrong.

· Founder & AI Consultant, IOTAI8 min read

For most of the past two years, the story of business AI has been a story of a handful of expensive frontier models from a small number of American labs. If you wanted the best reasoning, you paid for it, and the cost of running AI at any real volume was a genuine barrier for smaller businesses.

That picture has changed quickly in 2026. A wave of capable open-weight models, many of them from Chinese labs, has closed much of the gap with the frontier while costing a fraction as much to run. The result is one of the fastest price collapses the industry has seen. For Australian SMEs weighing up whether AI is affordable, this is a genuinely important shift, but it comes with trade-offs that are easy to get wrong. This article covers what is happening and how to take advantage of it sensibly.

What Has Actually Happened

The short version: the quality of models you can run cheaply, or even host yourself, has risen sharply, and the price of inference has fallen with it.

Open-weight models from labs like DeepSeek, Alibaba's Qwen, Zhipu's GLM and Moonshot's Kimi have gone from curiosities to serious options. On the routing platforms where developers pick models by price and capability rather than brand, these models now handle a large and growing share of all traffic, and a meaningful slice of that usage now comes from Western companies choosing them on the merits. The reason is straightforward: for many everyday tasks they are good enough, and they are dramatically cheaper.

How much cheaper? For a lot of practical work, open-weight options run at something like a tenth to a third of the cost of the leading proprietary models, and the very cheapest are cheaper still. A coding or document-processing session that costs several dollars on a top-tier frontier model can cost a few cents on a cheaper open-weight one. When you are running a process thousands of times a month, that difference stops being a rounding error and starts being the difference between a workflow that pays for itself and one that does not.

None of this means the frontier labs have been displaced. The best proprietary models from Anthropic, OpenAI and Google still lead on the hardest reasoning, the longest and most complex tasks, and the most demanding agentic work. What has changed is that the floor has risen. The gap between "the best model money can buy" and "a model that is genuinely good enough for this task" has narrowed to the point where, for a large share of business work, paying frontier prices is a choice rather than a necessity.

Why This Matters for Smaller Businesses

The businesses that benefit most from this shift are precisely the ones that were most priced out before: medium and small businesses that are curious about AI but wary of the cost. Three things change for them.

The economics of more use cases now work. A workflow that was borderline at frontier prices, worth automating but not by much, becomes clearly worthwhile when the model cost drops by an order of magnitude. Whole categories of high-volume, moderate-complexity work, classification, extraction, summarisation, first-draft generation, routine customer replies, move from "too expensive to be worth it" to "obviously worth it." As we cover in our ROI guide, the model cost is often the line item that decides whether an automation clears the bar. Lower it, and more things clear.

Experimentation gets cheaper. When running the model is expensive, every experiment carries a cost, and businesses become cautious about trying things. When inference is cheap, you can afford to test, iterate and prototype freely. That lowers the risk of getting started and speeds up learning.

Self-hosting becomes realistic. Because many of these models are open-weight, you can run them on your own infrastructure rather than sending data to a third-party API. For Australian businesses with data-residency or confidentiality concerns, this is significant: it means capable AI without your data leaving your control. This is the same logic behind self-hosting n8n for data residency, applied to the models themselves.

The Trade-Offs You Cannot Ignore

Cheaper is not automatically better, and the businesses that get this wrong tend to do so by chasing the lowest price without weighing what comes with it.

Cheapest Is Not the Same as Right

The correct model for a task is the cheapest one that does the job reliably, which is not the same as the cheapest one available. A model that costs a tenth as much but fails on a fifth of your cases is not a saving; it is a quality problem with a rework cost attached. The discipline is to match the model to the task, use a cheaper model where it performs well, and reserve the expensive frontier models for the work that genuinely needs them. This is the same task-fit thinking we set out in choosing the right AI model tier.

Data Sovereignty and Where the Model Runs

There is an important distinction between using an open-weight model and using a hosted API from an overseas provider. If you self-host an open-weight model on Australian infrastructure, your data stays under your control. If you call a cheap model through an overseas-hosted API, your data is going to that provider, under their jurisdiction and their terms, and for models hosted in some jurisdictions that raises real questions about privacy, confidentiality and compliance. For anything involving sensitive or regulated data, where and under whose control the model runs matters as much as what it costs, a point we explore in data sovereignty in the age of AI.

The Cost of Switching and Maintaining

A model is not a permanent decision. New models arrive constantly, prices move, and the best choice for a task changes over time. Building your automation so that you can swap the underlying model without rebuilding the whole workflow is what lets you keep taking advantage of falling prices. Tie yourself rigidly to one provider and you lose that flexibility, which is one of the arguments for the open standards, like the Model Context Protocol, that keep the plumbing portable.

How to Think About It: A Model Portfolio

The practical takeaway is that model choice is no longer a single decision. It is a portfolio, matched to the shape of each task:

Task typeSensible defaultWhy
High-volume, routine (classify, extract, summarise)A cheaper open-weight modelGood enough, and volume makes cost decisive
Sensitive or regulated dataA self-hosted open-weight modelKeeps data under your control
Complex reasoning or agentic workA frontier proprietary modelThe hardest tasks still reward the best models
Prototyping and experimentationA cheap modelIterate freely, upgrade later if needed

Most businesses do not need to build this themselves, and the point is not to become an expert in a dozen models. The point is to recognise that using one expensive model for everything is now leaving money on the table, and using one cheap model for everything is a quality risk. The value is in matching the model to the work.

What to Watch For

  • Chasing the lowest price and ignoring quality. A model that fails often is not cheap, whatever its per-token price. Measure reliability, not just cost.
  • Sending sensitive data to overseas-hosted APIs without checking. "Cheap model" and "self-hosted" are not the same thing. Know where your data is going before you send it.
  • Hard-wiring one model into your workflows. Prices and models change monthly. Build so you can swap the model without rebuilding the automation.
  • Assuming cheaper models are always Chinese, or always suspect. The open-weight field is broad and moving fast. Judge each model on capability, cost and where it runs, not on its flag.

Getting It Right

The falling cost of AI is genuinely good news for Australian SMEs. Work that was too expensive to automate a year ago is now clearly worthwhile, experimentation is cheap, and self-hosting capable models on your own infrastructure is realistic. But capturing that value depends on matching the model to the task, keeping sensitive data where it belongs, and building your automations so you can keep swapping in the best option as prices fall further.

This is exactly the kind of decision that benefits from an outside view, and it is part of why we describe our role as a managed intelligence provider: staying across the fast-moving model landscape so you do not have to, and picking the right tool for each job on your behalf.

At IOTAI, we help Australian businesses take advantage of cheaper, more capable models without getting the trade-offs wrong. Our free assessment will identify where cheaper AI could unlock value in your business, and you can book a consultation to talk through the right model strategy for your workflows.

The cost of AI is falling fast. The businesses that benefit are the ones that treat model choice as a deliberate decision, not a default.

Founder & AI Consultant, IOTAI

IOTAI is Australia's leading AI consultancy and Managed Intelligence Provider, specialising in Retool, n8n, and AI agent development for SMEs.

Ready to Implement These Strategies?

Our AI consultants can help you put these insights into action with tailored automation solutions for your business.