Last week, a business owner told me she'd pasted a confidential client contract into a chatbot. Then she paused and asked, "Wait, where did that just go?"
It's a fair question, and it points to a bigger one. Most of us default to the biggest, smartest AI for everything. But there's a second option now: small models that run entirely on your own laptop. So I compared one of them, Qwen 3.5 (9B), against Anthropic's flagship, Claude Opus 5.5.
01The side-by-side
| Qwen 3.5 (9B), local | Claude Opus 5.5 | |
|---|---|---|
| Cost | Free per use. You only pay for the computer | About $4 per million words read, $20 per million written (roughly) |
| Privacy | Your data never leaves your machine | Your data goes to Anthropic's servers |
| Works offline | Yes | No |
| Memory for long documents | Limited by your computer | Up to about a million "words" at once |
| Hard, multi-step work | Struggles with long, complex projects | Built for it, like running a project for hours |
| Everyday tasks | Strong: summaries, drafts, sorting | Excellent |
| Setup | Needs a decent laptop and some tinkering | None. Log in and go |
02Where each one wins
Qwen punches above its weight. It scores well on general knowledge and reasoning tests, which is impressive for a model that fits on a laptop. For the routine work that fills most business days, such as summarizing a contract, drafting a reply, or sorting customer feedback, it does the job without a monthly bill. And nothing leaves your machine, which answers that business owner's question.
But on tough, multi-step work, Opus is in another league. One independent tracker has it beating a rival flagship on 23 of 25 shared tests. When a task takes hours, touches many moving parts, and a wrong answer is costly, that gap shows up quickly.
A caution: treat these figures as ballparks. Many come from third-party trackers, not the companies themselves, and the two models were rarely tested on the same exams.
03The takeaway
You don't have to pick one. Use a local model for sensitive documents and high-volume busywork. Bring in a flagship like Opus when the problem is hard and the stakes are high.
Not every task needs your most powerful tool. The smart move is knowing which is which.
That's exactly what we do. We build custom AI agents for brands, small businesses, and busy owners. Each one is matched to the job, the budget, and how private your data needs to be, so you're not guessing which model to use or wrestling with setup.
Ready for an AI agent built around your business?
Tell us where your time goes and we'll show you where an agent fits. Your first AI agent is on us.
Book an exploratory call with us here