Last week, a business owner told me she'd pasted a confidential client contract into a chatbot. Then she paused and asked, "Wait, where did that just go?"

It's a fair question, and it points to a bigger one. Most of us default to the biggest, smartest AI for everything. But there's a second option now: small models that run entirely on your own laptop. So I compared one of them, Qwen 3.5 (9B), against Anthropic's flagship, Claude Opus 5.5.

01The side-by-side

Qwen 3.5 (9B), localClaude Opus 5.5
CostFree per use. You only pay for the computerAbout $4 per million words read, $20 per million written (roughly)
PrivacyYour data never leaves your machineYour data goes to Anthropic's servers
Works offlineYesNo
Memory for long documentsLimited by your computerUp to about a million "words" at once
Hard, multi-step workStruggles with long, complex projectsBuilt for it, like running a project for hours
Everyday tasksStrong: summaries, drafts, sortingExcellent
SetupNeeds a decent laptop and some tinkeringNone. Log in and go

02Where each one wins

Qwen punches above its weight. It scores well on general knowledge and reasoning tests, which is impressive for a model that fits on a laptop. For the routine work that fills most business days, such as summarizing a contract, drafting a reply, or sorting customer feedback, it does the job without a monthly bill. And nothing leaves your machine, which answers that business owner's question.

But on tough, multi-step work, Opus is in another league. One independent tracker has it beating a rival flagship on 23 of 25 shared tests. When a task takes hours, touches many moving parts, and a wrong answer is costly, that gap shows up quickly.

A caution: treat these figures as ballparks. Many come from third-party trackers, not the companies themselves, and the two models were rarely tested on the same exams.

03The takeaway

You don't have to pick one. Use a local model for sensitive documents and high-volume busywork. Bring in a flagship like Opus when the problem is hard and the stakes are high.

Not every task needs your most powerful tool. The smart move is knowing which is which.

That's exactly what we do. We build custom AI agents for brands, small businesses, and busy owners. Each one is matched to the job, the budget, and how private your data needs to be, so you're not guessing which model to use or wrestling with setup.

Ready for an AI agent built around your business?

Tell us where your time goes and we'll show you where an agent fits. Your first AI agent is on us.

Book an exploratory call with us here
John Bohan

About the Author & Kamana

John Bohan, CEO of Socialtyze, launched Kamana after recognizing how AI could transform the way companies run. Kamana helps businesses streamline operations, centralize intelligence, and create more time for the work that actually grows the company.