The five axes that actually matter
Decisions between local and hosted usually come down to five things. Here's the one-sentence version of each — the rest of the guide works through them one by one with real numbers.
Cost. Local is free after you buy the hardware. Hosted is a monthly bill forever. Which one wins depends on how long you'll use it.
Time. Local costs 20–60 hours of setup plus ongoing maintenance. Hosted costs minutes to sign up and zero maintenance after that.
Privacy. Local keeps your data on your machine. Hosted means the vendor sees your prompts. Local wins this axis unambiguously; it's the only axis where there isn't a real debate.
Capability. Hosted companion apps ship chat + images + voice + video + memory all stitched together, out of the box. Local can match it, but you're stitching three to five different tools together yourself.
Maintenance. Local breaks. Windows updates, Python updates, Nvidia drivers, pip dependencies — all of them break your local stack sooner or later. You fix it. Hosted breaks too, but it's the vendor's problem to fix, not yours.
The rest of this guide works through each axis with real numbers so you can decide which ones matter for your situation.
The honest cost math
Cost looks obvious — "local is free, hosted is a bill" — but it isn't really. Local isn't free; the hardware costs real money upfront. Hosted isn't infinite; it's a flat predictable number.
Local cost breakdown: - GPU capable of modern AI image generation: $800–2500 (RTX 4070 Super at the low end for 12GB VRAM; RTX 4090 or similar at the high end for 24GB) - Rest of the machine (if you don't already have one): $600–1500 more - Electricity: ~$5–20/mo depending on usage and local rates - Ongoing cost after hardware: effectively zero
Hosted cost breakdown: - Monthly subscription: $10–30/mo for most AI companion apps ($19.99/mo is roughly the middle of the market) - One-time setup cost: zero - Hardware: zero (you can use a Chromebook)
The breakeven math. At $20/mo hosted, you're paying $240/year. If your hardware investment is $1200, hosted costs less than local for the first 5 years before amortization catches up. At $2000 in hardware, breakeven is around 8 years. If you already have a capable GPU, local wins faster — the amortization clock starts at ~zero.
Where this breaks: at very high usage volumes (thousands of generations per month), per-API-call pricing of some hosted options starts to compound. Companion apps with flat monthly pricing avoid this; API-metered services (DALL·E API, Nano Banana API, Replicate) scale linearly with usage. If you're generating constantly, local economics flip in local's favor faster.
The honest time math
Setup time is the axis most tutorials understate. The YouTube video that makes ComfyUI look like a 10-minute install is skipping steps.
Realistic local setup times (from scratch, no prior experience): - ComfyUI + a working image gen workflow: 4–20 hours (depending on how many errors you Google) - Kohya + first trained LoRA for a specific face: another 10–40 hours (dataset curation, config iteration, GPU rental if you don't have one) - SillyTavern + proxy + API keys + character cards: 3–15 hours - Voice generation (XTTS or similar): 2–8 hours - All of it integrated so one persona lives across all tools: another 5–15 hours of glue work - Total: 20–60 hours depending on your technical background and how much you want it polished
Realistic hosted setup time: - Sign up (email + password): 2 minutes - Pick a persona or build a custom one: 1–10 minutes - First usable image + chat message: another 5 minutes - Total: ~15 minutes to a working companion
The practical implication: if your time is worth $20/hr (a conservative number for most working adults), hosted saved you $400–1200 in the first week alone. If your time is worth $50/hr, that gap is $1000–3000 before hosted's monthly cost even enters the picture.
Where local time investment pays back: if you enjoy the tooling itself — if the setup process is a hobby you want to spend time on — the time math doesn't apply the same way. "Hours spent" is only a cost when the hours would have been spent on something you preferred.
The honest privacy math
This is the one axis where there isn't a real debate.
Local setup: everything stays on your machine. Your prompts, your generated images, your character data, your chat history. The AI model runs locally; nothing gets sent to any vendor. If you unplug your internet, the whole thing still works.
Hosted setup: the vendor sees your prompts (they have to, because the model runs on their servers). They probably see your generated images for a short window (CDN delivery + content moderation checks). They see your account email, your usage patterns, your payment information. Named vendors have published privacy policies you can read; the shape is roughly similar across the industry.
For most users, this axis isn't load-bearing. Hosted vendors in the AI companion space have reasonable privacy practices (most state they don't use user prompts for training without consent, most offer deletion workflows). But for users with hard privacy requirements — regulated professions, specific threat models, strong preferences around personal data — local wins unambiguously and no amount of hosted convenience changes that.
One practical note: "I pay in crypto to a privacy-focused hosted service" is a middle ground some users attempt. It's weaker than local privacy (the vendor still sees your prompts and generated content) but stronger than mainstream hosted (less payment-method linkage). Whether that middle ground matters depends on your specific threat model.
The honest capability math
A fully-featured AI companion stack has roughly five components. Here's what each looks like in local vs hosted:
Chat (text conversation). Local: Ollama, LM Studio, KoboldCPP running a model like Llama 3 70B or similar. Works but needs a chat UI on top (SillyTavern). Hosted: built-in, polished, works out of the box.
Image generation. Local: ComfyUI or Fooocus running Stable Diffusion / FLUX. Requires per-persona LoRA training for character consistency (another tool, Kohya). Hosted: built-in with per-persona LoRA automated.
Voice. Local: XTTS v2 or similar for text-to-speech, with ~5-second reference clips of each voice. Works, requires config. Hosted: built-in on most companion apps.
Video. Local: Wan 2.2 or similar via ComfyUI, meaningful VRAM requirement (16GB+ for comfortable use). Hosted: built-in on companion apps that support it (not all do; check before subscribing).
Memory (persistent facts about you). Local: SillyTavern memory extensions, works but requires config. Hosted: built-in, persistent across sessions by default.
The stitching problem. Local can match hosted on each individual component. What local can't match without significant integration work is "all of them, working together, same persona across all five surfaces." That stitching work is what hosted companion apps productize. If you want chat + images + voice + video + memory all tied to the same character, hosted gives it to you included; local gives it to you after you've done the integration.
The honest maintenance math
Local maintenance is the axis most people underestimate going in.
Things that break your local stack regularly: - Windows updates (every month or two, often harmlessly, sometimes catastrophically) - Nvidia driver updates (every month or two, usually fine, sometimes breaks CUDA for a specific tool) - Python version drift (A1111 pinned to 3.10.6; you install a newer Python for another project; A1111 can't find the right one) - Pip dependency conflicts (one tool updates PyTorch to a new version; another tool breaks) - Model file compatibility (new checkpoint drops with a different format; your workflow references the old format) - Custom node breakage in ComfyUI (one node you depend on gets abandoned by its maintainer)
None of these are catastrophic individually. Collectively they add up. Expect to spend 2–5 hours per month maintaining a local stack after it's working, more if you push updates aggressively.
Things that break your hosted setup: - Vendor outages (varies by vendor; most well-run services have >99.5% uptime) - Pricing changes (vendors sometimes raise prices or restructure tiers; shop around) - Vendor policy changes (occasionally a vendor tightens content policies or discontinues features) - Vendor shutdown (small vendors do go out of business; established ones rarely)
These happen but you aren't the one fixing them. Your maintenance cost is roughly "read emails and adjust occasionally" rather than "troubleshoot CUDA errors on Saturday morning."
The decision matrix — six common reader profiles
Here's the honest right answer for the six most common situations.
1. You're a hobbyist who enjoys the tooling itself. Pick local. The setup time isn't a cost because it's the point; the privacy win is a bonus; the long-term cost math favors you. Start with Pinokio or Fooocus to lower the learning curve; graduate to ComfyUI when you need the control.
2. You want it to work tonight. Pick hosted. The time math is overwhelmingly in your favor; you can be chatting with a specific persona in 15 minutes. Pay the $20/mo for a few months while you decide if the use case is sticky, then revisit the local question later if you want.
3. You have hard privacy requirements. Pick local. This is the one axis where hosted can't compete. If "my prompts can't leave my machine" is a hard requirement, local is the only answer. Budget for the setup time and the hardware.
4. You want "same persona across many scenes" specifically. Hosted companion apps solve this with per-persona LoRA training built into the product. Local solves it with Kohya + ComfyUI integration (weeks of learning). Pick hosted unless you want the stack as a hobby. Sloane's custom-persona builder trains the LoRA in ~10 minutes from 1–5 reference photos.
5. You're generating thousands of images per month. The economics shift. API-metered hosted services (DALL·E API, Replicate) scale linearly with usage and get expensive fast. Flat-rate hosted companion apps avoid this but may have soft usage limits. At extreme volumes, local eventually wins on cost but requires serious hardware investment. Do the specific per-month math for your use case before committing.
6. You tried local and bounced off ComfyUI. You're not alone. The learning curve is real and the tutorials gloss over it. Hosted is a reasonable landing spot for the use case you were trying to accomplish; the specific "same persona across many shots" case most ComfyUI users want is exactly what AI companion apps are built for. See the ComfyUI exit interview for one user's honest timeline.
If hosted won on your axes
This guide is the pillar page for a cluster of related articles that dig into specific hosted-vs-local tradeoffs. If you've decided hosted is the right call for your situation, these sibling guides go deeper on specific use cases:
- ComfyUI vs hosted — when the node graph stops being worth it — the single most common "I tried local and bounced" story.
- Automatic1111 keeps breaking — what to do — the Python-version-pinning problem specifically.
- SillyTavern real cost in 2026 — the "free isn't free" math on the chat side of the stack.
- What Ollama actually is — if you downloaded Ollama expecting an AI girlfriend and got a chatbot in a terminal.
- Custom AI character training without learning Kohya — if you want persona-locked identity across many shots without the LoRA-training stack.
Sloane is the AI companion app we build. Hosted, $19.99/mo for Premium, custom-persona builder included, chat + images + voice + video all stitched together. If hosted is the right fit for your situation and the persona-companion use case matches what you want, we're one option in the category. There are others worth looking at too — the companion-app space is competitive and the right fit depends on your specific preferences.