cheap LLMtext classificationsummarisationAI cost optimisationmodel selection

Best Cheap LLM for Classification and Summarisation (2026)

Classification and summarisation are the two jobs where a cheap model most often does fine, and where a benchmark most often lies about it. This is the honest shortlist, the real per-token prices, why cheapest-per-token is not cheapest-per-task, and how to tell which cheap model is actually good enough on your own prompts before you move a single request.

By Roman Rose, Founder, Parity Layer11 min read

Key takeaways

  • There is no single best cheap LLM for classification and summarisation. The cheapest models good enough for these jobs at the time of writing are Gemini 2.5 Flash-Lite, GPT-5 nano and GPT-5 mini, with Claude Haiku 4.5 a step up when strict output format matters, all roughly 10 to 30 times cheaper per token than a frontier model.
  • Cheapest per token is not cheapest per task. A weaker model that needs longer prompts, retries or human review can cost more in total than a slightly dearer model that gets it right first time.
  • Classification and summarisation fail differently. Classification breaks loudly (wrong label, broken JSON) and is easy to check; summarisation breaks quietly (a dropped caveat, a subtle distortion) and needs a real judge, not a glance.
  • A leaderboard cannot tell you which cheap model is good enough for your prompts, because your support macros and extraction schemas are not the benchmark. The only test that settles it is your own prompts, judged blind against your current model's own consistency.
  • Prove it offline first. Export a JSONL of past requests, measure where a cheaper model holds parity on your real traffic, then route only what passed. On the prompts that pass, savings typically land in the 30 to 60% range. None of this is for coding agents.

There is no single best cheap LLM for classification and summarisation, and any list that hands you one name is selling you a benchmark rather than an answer. The honest version: at the time of writing the cheapest models good enough for these two jobs are Gemini 2.5 Flash-Lite and GPT-5 nano on price, GPT-5 mini a small step up, and Claude Haiku 4.5 dearer but steadier where strict output format matters, all of them roughly 10 to 30 times cheaper per token than a frontier model. Which of them is actually good enough for your prompts is the question none of them can answer for you, and it is the part that decides whether you save money or quietly break something.

A note on scope before we start. This piece is only about the three providers most teams already call through an API: OpenAI, Anthropic and Google. It deliberately leaves out the tier below them, the open-weight and self-hosted models (Llama, Qwen, DeepSeek and the rest) that can cut the sticker price further still. Everyone knows those exist and that they are cheaper. The catch is that they are a different decision entirely: they move the cost to hosting, scaling and reliability you own, and the quality question does not go away, it still has to be proven on your prompts. That deserves its own piece. Everything here stays inside the big three, where moving to a cheaper model is a config change rather than an infrastructure project.

That matters because classification and summarisation are where most teams should start cutting an AI bill. They are high frequency, well defined, and they are the jobs a cheaper model most often does just as well. They are also the jobs a leaderboard is most likely to be wrong about, in opposite directions, which is why picking on price alone is how a visible cost problem turns into an invisible quality one.

The one sentence to remember

The best cheap model for classification and summarisation is whichever one you have proven holds quality on your own prompts. Everything before that proof is a shortlist, not a decision.

What is the best cheap LLM for classification and summarisation?

On price today that means Gemini 2.5 Flash-Lite and GPT-5 nano, with GPT-5 mini a step up and Claude Haiku 4.5 where format matters. But price is the easy half, so start from what our own data actually shows about whether a cheap model from the big three survives contact with real work.

Across 16,764 blind comparisons from 145 companies, the Parity Index found a cheaper model held or beat the more expensive one it replaced 85.5% of the time. On JSON extraction, the task type closest to classification that we track, it held quality 91.2% of the time across 1,697 blind comparisons. "Held quality" means the cheaper model matched or beat the model it was standing in for, judged blind by the customer's own baseline model.

Source: the Parity Index (paritylayer.com/proof-index), 16,764 blind comparisons across 145 companies, as of August 2026. The 2.0 and 4.1 generation below is what teams have actually been routing this year; the current successors named above are cheaper again and worth testing the same way.

Cheap model (provider)Held quality (Parity Index)Reach for it when
Gemini 2.0 Flash-Lite (Google)92%, across 3,767 comparisons at 43 companiesIt is your default first move. Our most-tested cheap model, and it holds, especially on classification and extraction.
GPT-4.1 nano (OpenAI)91%, across 455 comparisons at 9 companiesYou want OpenAI's cheapest tier and still want it to hold most of the time.
GPT-4.1 mini (OpenAI)Held 86%, and beat the dearer model 28% of the time, across 167 comparisonsYou would take genuinely better output, not just equal. It comes back better more often than any other tier here.
Claude Haiku 4.5 (Anthropic)Held 80%, beat 28%, against a frontier model, on a small sample so farStrict output format and schema adherence matter more than squeezing the last cent.

What carries across generations is the pattern, not the decimal. A cheap model from the big three holds far more often than the received wisdom says, and the only way to learn your own number is to run it on your own prompts. That last part is the job Parity does when it proves a cheaper model on your own prompts, and it is the one check none of the models above run on themselves.

Which cheap models are actually worth testing?

A short, current shortlist beats a sprawling list of fifty. This is the shortlist for these two jobs specifically, not a general price index, with real list prices per million tokens at the time of writing. Prices move fast and unevenly, so treat these as a snapshot and check the vendor page before you commit (Epoch AI).

ModelInput per 1MOutput per 1MSource
GPT-5 nano$0.05$0.40OpenAI pricing
Gemini 2.5 Flash-Lite$0.10$0.40Gemini pricing
GPT-5 mini$0.25$2.00OpenAI pricing
Gemini 2.5 Flash$0.30$2.50Gemini pricing
Claude Haiku 4.5$1.00$5.00Anthropic pricing
GPT-5 (frontier anchor)$1.25$10.00OpenAI pricing

One honest footnote. Gemini 2.5 Flash-Lite is scheduled to retire on 16 October 2026, with Gemini 3.1 Flash-Lite named as the successor at $0.25 and $1.50, so if you are building for the long run, test the successor too.

The gap is the story. A cheap-tier model is commonly 10 to 30 times cheaper per token than the frontier model on the same task, and for a large fraction of classification and summarisation traffic it returns an answer you could not tell apart from the expensive one. That is a real, standing invitation to move down a tier. Accepting it without checking is the mistake, because the per-token gap is not your saving. For the full task-versus-token framing behind that shortlist, I wrote up the cheapest LLM APIs ranked by task, not token.

Why a cheap classifier that retries is not a cheap classifier

Because a weaker model that needs more scaffolding can cost more to reach a correct answer than a dearer model that gets it right first time. Cheaper models often need longer prompts, more few-shot examples, the occasional retry, and more human review to catch what they got wrong. Each of those adds tokens, latency or salary, and none of them shows up in the per-million-token price.

So the number that actually matters is total cost to a correct result on your workload, not the sticker price. A model at a third of the token cost that doubles your retry rate and adds a human check on every tenth output is not a saving, it is a cost transfer. This is also why the advice to "just use the cheapest model" and the advice to "just prompt harder" both miss: the cheaper model can be the right call, but only once you have measured what it costs you to make it reliable, which for classification and summarisation is usually modest and occasionally not. If the fix is heavier prompting, prompt engineering for cheaper models is worth reading before you rule a model out.

Why classification and summarisation are different problems for a cheap model

They fail in opposite ways, so you cannot evaluate them the same way.

Best cheap LLM for classification

For classification, start with Gemini Flash-Lite or the OpenAI nano tier, and expect a cheap model to hold more often than not. Classification fails loudly. The label is wrong, the JSON is malformed, the enum is off list. These are cheap to catch because they are checkable against a fixed answer, which is exactly why classification is the friendliest job to move to a cheaper model. The Parity Index bears it out: on JSON extraction, the task type we track that sits closest to classification, a cheaper big-three model held quality 91.2% of the time across 1,697 blind comparisons. The direction is real, and it is measured on production prompts rather than a benchmark: for narrow, well-defined labelling, bigger is often not better, just dearer.

Best cheap LLM for summarisation

For summarisation the shortlist is the same but the bar is higher, so favour a step up (the mini tier, or Claude Haiku where faithfulness matters) and judge the output rather than trusting a score. Summarisation fails quietly. A cheaper model can write a fluent, confident summary that drops the one caveat that mattered, softens a number, or quietly invents a supporting detail. Nothing errors. The response is a clean HTTP 200 that reads well, and the distortion surfaces later, in a decision made on a summary nobody re-read. That is the failure a benchmark score and a quick skim both miss, and it is why summarisation needs a judge on the actual output, not a leaderboard position. The two jobs share a shortlist but not an evaluation method, and the model that wins one does not automatically win the other.

How do you know a cheap model is good enough for your prompts?

You test it on your own prompts, blind, against the model you run now. That sounds obvious and almost nobody does it, because the tempting shortcut is to read a benchmark and switch. The trouble is that public benchmarks are not your traffic, and they are exactly the surface that gets contaminated and gamed, with leaderboard positions shifting on undisclosed testing rather than genuine capability (Singh et al., The Leaderboard Illusion, 2025). Even the good, honest router research reports its headline on public benchmarks: RouteLLM reports large cost reductions while holding around 95% of GPT-4 quality on MT-Bench (Ong et al., 2024). That is a strong third-party result and a hypothesis about your prompts, not a measurement of them.

The measurement that settles it has three parts. First, judge the outputs blind, and never let one of the two models being compared act as the judge, because models favour their own family's output, a bias documented alongside position and verbosity bias in the foundational LLM-as-judge work (Zheng et al., 2023). Second, set the pass bar from your own model's run-to-run consistency: ask your current model the same prompt twice and the answer already shifts a little, so a cheaper model passes when it disagrees with your baseline no more than your baseline disagrees with itself. That way the standard is your model, not a vendor's. Third, gate on drift, not vibes: format checked as a hard exact-match gate, meaning-level differences re-judged blind, so a difference only counts against the cheaper model when a fair judge actually prefers the original.

You can run all of that offline, before you change a line of code, on a JSONL export of past requests. That is the version I would start with, because it changes nothing in production while it measures. The full walk-through of the loop, blind paired judging, swapped answer order and confidence intervals, is in how to prove a cheaper model is good enough, and for the shape of the decision itself, how good a cheaper model actually needs to be. The aggregate of these proofs across real prompts, including the honest share where the cheaper model lost, is the live ranking.

When should you keep the expensive model?

Whenever the cheaper one has not cleared the bar, and there are jobs where it rarely will. Long reasoning chains, ambiguous instructions, anything where a wrong answer is expensive and hard to detect, tend to stay on the stronger model, and that is a feature of an honest process, not a failure of it. When the proof runs across a real prompt mix, a meaningful share does not pass, and those prompts should stay exactly where they are.

One caveat stated plainly, because it is true: none of this is for coding agents. Long-horizon agentic coding is the broad, high-variance work where cheaper models still lose and no honest bar will tell you otherwise. This is about the high-frequency, well-defined jobs a business runs all day, classification, extraction, summarisation, qualification and generation off structured data, which is also where most of a bill quietly hides. For the shape of that bar itself, see how good a cheaper model actually needs to be.

Put together, the answer to "best cheap LLM for classification and summarisation" is a method, not a model. Draw up the shortlist by price and reported strengths, then prove the candidates on your own prompts, route only what passed, and keep the incumbent armed as an instant fallback. On the prompts that pass, the saving typically lands in the 30 to 60% range, and it is provable rather than hoped for. If you want the wider playbook that sits behind this, the LLM cost optimisation guide is the pillar. And if you would rather see the numbers for your own traffic first, you can measure exactly how much you are overspending on your AI API bill on a JSONL export, before switching anything.

Frequently asked questions

How often does a cheaper model actually hold quality?

Across 16,764 blind comparisons from 145 companies, the Parity Index (paritylayer.com/proof-index) found a cheaper model held or beat the more expensive one it replaced 85.5% of the time. On JSON extraction, the task type closest to classification, it held 91.2% of the time across 1,697 comparisons. Those are aggregates across many companies and prompt types, so treat them as evidence that switching down a tier is usually safe on well-defined work, not as a promise about your own prompts. The share where the cheaper model did not hold is published too, because that is the number that tells you the measurement is real.

What is the best cheap LLM for classification and summarisation?

There is no universal winner. On raw price, GPT-5 nano and Gemini 2.5 Flash-Lite are the cheapest credible options; GPT-5 mini sits just above them; Claude Haiku 4.5 costs more but is often preferred where strict output format matters. All of them are roughly 10 to 30 times cheaper per token than a frontier model. Which one is good enough for your prompts depends on your prompts, so the right move is to test the shortlist on a sample of your own real inputs rather than trust a ranking.

Is a cheap model good enough for text classification?

Very often, yes, and this is the single best place to start cutting cost. Classification is a well-defined, high-frequency job with a checkable answer, which is exactly where a smaller model tends to hold. Reported benchmarks show small models matching or beating far larger ones on narrow classification tasks. The caveat is that good enough depends on your label set and your edge cases, so you still prove it on your own data before you switch the traffic that matters.

Is a cheap model good enough for summarisation?

Usually for plain summarisation, less reliably for anything with strict faithfulness requirements. The risk with summarisation is quiet: a cheaper model can produce a fluent summary that drops a caveat, softens a number or invents a small detail, and it still returns a clean HTTP 200 that looks like success. So summarisation needs an actual quality check on the output, not a benchmark score and not a skim, before you move high-stakes summaries to a cheaper model.

Why is the cheapest model per token sometimes the most expensive in practice?

Because cost per token is not cost per task. A weaker model often needs longer prompts, more few-shot examples, occasional retries and more human review, and each of those adds tokens or time. A model that is dearer per token but gets the answer right first time can be cheaper per completed task. The number that matters is total cost to a correct result on your workload, not the sticker price per million tokens.

How do I prove a cheaper model is good enough before switching?

Take a representative sample of your own real prompts, run both the cheaper candidate and the model you use now, and judge the outputs blind, with the pass bar set by how much your current model already disagrees with itself when you ask it twice. A cheaper model passes when it disagrees with your baseline no more than your baseline disagrees with itself. Route the prompt types that pass, leave the rest, and keep an instant fallback. You can do the whole thing offline on a JSONL export before touching production.

Sources

  1. 1.The Parity Index: Parity Layer's public aggregate of blind model comparisons (16,764 comparisons across 145 companies)
  2. 2.OpenAI API pricing (GPT-5, GPT-5 mini, GPT-5 nano per-token rates)
  3. 3.Google Gemini API pricing (Gemini 2.5 Flash, Flash-Lite, 3.1 Flash-Lite)
  4. 4.Anthropic / Claude API pricing (Claude Haiku 4.5)
  5. 5.Epoch AI: LLM inference prices have fallen rapidly but unequally across tasks
  6. 6.Ong et al. (2024): RouteLLM: Learning to Route LLMs with Preference Data
  7. 7.Singh et al. (2025): The Leaderboard Illusion
  8. 8.Zheng et al. (2023): Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena

Prove it on your own prompts

See whether a cheaper model matches or beats your output for 30-60% less. Unlimited prompts proven free, no credit card.

Keep reading