GUIDE

Local AI Girlfriend: Why Is This So Hard to Set Up?

Updated October 16, 2026

You want to run an AI girlfriend on your own computer. You read somewhere that KoboldCPP is "just a single executable." You downloaded it. You hit "no AVX2 support" or "model file not found" or a Python error. You tried Oobabooga. Different error. You tried LM Studio. Model loaded but the chat is empty — no character, no memory, no photos. This is why.

TL;DR

  • A functional "AI girlfriend" is three separate tool stacks that nobody warned you need to be stitched together: the AI model runner, the chat character interface, and the image generation stack.
  • KoboldCPP, Oobabooga, Ollama, LM Studio run the text AI — just the brain, no personality. SillyTavern provides the chat character — just the face, needs a brain. ComfyUI generates the images. All three are separate.
  • The specific error messages beginners hit most: "no AVX2 support" (your CPU is too old), "model file not found" (you need to download it), ModuleNotFoundError (Python environment issue). All documented below with plain-English translations.
  • Hosted AI companion apps bundle all three stacks into one subscription ($10-30/mo) because nobody was DIY-stitching this in large numbers — it's too much work for most users.
  • When local still wins: privacy is a hard requirement, you plan to use it 10,000+ messages/month, or you enjoy the tooling itself.
Sandra

Meet Sandra

Local AI girlfriend install not working? Sandra's on Sloane — $19.99/mo, everything stitched together, no three separate stacks.

Chat with Sandra →

Three different problems people mash together

An AI girlfriend is three separate things, each with its own tool stack:

1. The AI model (the brain). Something that generates text — the model that decides what she says. Tools: KoboldCPP, Oobabooga (text-generation-webui), Ollama, LM Studio. These are model runners — they load and serve the AI model. By themselves they have no personality; they're just the text-generation engine.

2. The chat character interface (the face). Something that gives her a persona, memory, chat UI, character cards. Tools: SillyTavern (dominant), RisuAI, Agnai. These are chat frontends — they give you an interface to talk to a character. By themselves they do nothing; they need a model to connect to.

3. The image generation stack (the body). Something that generates photos of her. Tools: ComfyUI, Automatic1111, Fooocus running Stable Diffusion / FLUX. These are image generators — separate from text generation entirely. For "same woman every photo," you also need per-persona LoRA training via Kohya (yet another tool).

Nobody warned you these are three separate stacks that need to be stitched together. The tutorials assume you already know this, so when you install KoboldCPP expecting an AI girlfriend and get a chat interface with no character, you think you did something wrong. You didn't; KoboldCPP just isn't that product — it's one of three pieces you need.

What each tool does (plain English)

KoboldCPP. Runs a text AI on your computer. Loads a model file (GGUF format), serves text generation on a local port. Just the brain, no face. Technical: a C++ llama.cpp wrapper, single-executable download, works on CPU and GPU.

Ollama. Also runs a text AI, with a friendlier CLI for downloading and managing models. Just the brain, no face. Technical: Go-written wrapper around llama.cpp with model-pulling via a package-manager-like interface.

LM Studio. Also runs a text AI, with a desktop GUI for managing models. Just the brain, has a built-in basic chat UI that's minimal (no character, no memory, no persona). Technical: Electron app wrapping similar inference libraries.

Oobabooga (text-generation-webui). Also runs a text AI with a web UI. Has somewhat more features than LM Studio's built-in chat (character support exists but is less polished than SillyTavern). Technical: Python/Gradio app with pluggable backends.

SillyTavern. Chat frontend. Gives you character cards, persistent memory, group chat, rich chat UI. Does NOT run the AI model itself — it points at whichever model runner you have serving on a local port, or at a hosted API. Just the face, needs a brain.

ComfyUI / Automatic1111 / Fooocus. Image generators. Separate from everything above. For "images of your specific character," also need a per-character LoRA trained via Kohya.

The glue work. Even with all tools installed and running, you need to configure SillyTavern to connect to your model runner, build or import a character card for your persona, train a LoRA for her face, build a workflow that calls image generation when you want it. Add another 10-20 hours of integration work on top of the setup of each individual tool.

The specific crashes beginners hit (and what each one means)

`illegal instruction (core dumped)` or `no AVX2 support`. Your CPU is too old to run the AI inference library at full speed. Common on older laptops. Fix: find a version of the tool with AVX fallback, or run on GPU instead of CPU, or get newer hardware.

`model file not found` or `can't find model`. You installed the tool but didn't download the actual AI model file (usually a .gguf or .safetensors file in the gigabyte range). Fix: find a model on Hugging Face, download it to the tool's models directory, point the tool at it.

`CUDA out of memory`. The model you're trying to run is bigger than your GPU VRAM. Fix: use a smaller model, use a more aggressively quantized version (Q4_K_M instead of Q8_0, for example), or run on CPU (much slower).

`ModuleNotFoundError` in Python-based tools. The Python environment doesn't have required dependencies installed. Fix: usually means the venv wasn't set up correctly; delete the venv folder and relaunch the tool to rebuild.

`failed to load model` without more specifics. Often a model-format incompatibility (you downloaded a model in a format the tool doesn't support). Fix: verify the model file is in the expected format (GGUF for KoboldCPP/Ollama/LM Studio, safetensors for most ComfyUI workflows).

`SillyTavern connects but no response`. SillyTavern is pointing at a model-server address that isn't serving a model. Fix: verify your model runner (KoboldCPP, Oobabooga, etc.) is actually running and listening on the port SillyTavern expects.

All of these are standard first-time setup errors. None of them are catastrophic once you know what they mean. The problem is beginners don't know what they mean, and the error messages assume you do.

The honest answer: if you want the whole thing stitched together, hosted was built for this

Hosted AI companion apps bundle brain + face + image gen + voice + memory into one subscription. The whole reason the category exists is that nobody was DIY-stitching this in large numbers because it's too much work for most users.

Sloane Premium at $19.99/mo includes: chat with 80+ hand-curated personas or custom-built ones (model + character all in one), persistent memory of who you are, per-persona photos (image gen + LoRA already trained), voice notes from the persona, short video clips. All one product. Sign up in 15 minutes.

Other hosted companion apps in the category:

Candy AI. Larger roster of anime and realistic characters. Image-first strength. See Candy AI review.

Character.AI. Massive roster of user-generated characters. The 2023 content policy shift hurt the product for many users. See will Character.AI allow NSFW? for current context.

Replika. Original AI companion product. The 2023 ERP removal fractured the user base; current state is more wellness-focused. See Replika alternatives after 2023 update for context.

Nomi, Kindroid, DreamGF, Muah AI, Pipsqueak. Smaller companion apps with specific angles. Varying strengths; worth comparing if the top three don't fit.

All of these productize the chat + memory + persona + images stack that local setups make you assemble yourself. Price is similar across the category ($10-30/mo for most). Setup is minutes vs. 20-60 hours.

When local still wins

Three situations where local is the correct answer despite the setup burden.

Privacy is a hard requirement. With local, your prompts and conversations stay on your machine; nothing leaves. Hosted companion apps have the vendor seeing your prompts, which matters if "my data can't leave my machine" is a non-negotiable constraint for your use case.

You plan to use it 10,000+ messages/month. Hosted monthly subscriptions include generous but not infinite usage. At high volumes (chat-constantly-every-day usage patterns), local avoids the ongoing cost ceiling. The breakeven depends on specific usage patterns; at very high volumes local wins on long-term economics.

You enjoy the tooling itself. If setting up the stack is part of what you got into this for — if the process is a hobby, not a cost — the setup time doesn't count as a drawback. Build the stack, iterate on it, enjoy the control. For users in this category, local wins because the "cost" axis of time investment is actually a benefit.

Outside of those three situations, hosted companion apps productize what you're trying to assemble. Reasonable people make different calls based on which situation they're in; both answers are defensible.

The 2026 hosted options

ServiceMonthlyStrengthsCaveats
SloaneFree · Plus $9.99 · Premium $19.99Persona-first, 80+ curated + custom builder, per-persona photos + voice + video, memoryWeb-first; no native mobile app yet
Candy AI~$14-20Deep anime + realistic roster, image-firstMemory thinner than persona-first competitors
Character.AIFree · C.AI+ $10Massive user-generated roster2023 content policy hurt trust; current state varies by tier
ReplikaFree · Pro ~$20Original product in category, mental-wellness angle2023 ERP removal fractured user base; current state is more wellness than companion
Nomi~$10-20Strong on persistent memorySmaller roster
Kindroid~$10Custom-character-first designSmaller user base
DreamGF~$10-20Image-focusedChat thinner than persona-first competitors
Pipsqueak~$10-20Specific anime / fantasy nicheNarrower use case

For "I want it to work tonight," any of the top three (Sloane, Candy AI, Character.AI) is a reasonable landing spot. Try a couple for a month before committing; flat monthly pricing makes experimentation cheap.

TRY SLOANE FREEWHAT OLLAMA ACTUALLY IS (AND ISN'T)

Everything stitched together · $19.99/mo · 15 minutes from signup

FREQUENTLY ASKED

Questions people ask

Why is setting up a local AI girlfriend so hard?

Because it isn't one tool — it's three separate stacks that need to be stitched together. KoboldCPP / Oobabooga / Ollama / LM Studio run the AI model (the brain). SillyTavern provides the chat character interface (the face). ComfyUI runs image generation (the body). Each tool is designed for its own thing; the glue work tying them together is on you. Hosted companion apps productize the integration.

What does "no AVX2 support" mean when running KoboldCPP?

Your CPU is too old to run modern AI inference libraries at full speed. AVX2 is a CPU instruction set that AI inference benchmarks against. Older CPUs (pre-2013 Intel, older AMD) lack it. Fixes: find a KoboldCPP build with AVX fallback (older, slower), run on GPU instead of CPU, or get newer hardware.

What model should I download for KoboldCPP or Ollama?

Depends on your VRAM. 8-12GB VRAM: a 7B or 13B parameter model in Q4_K_M quantization. 16-24GB VRAM: a 30B or 70B model at smaller quantization. For roleplay use cases, look at Hermes 3, Euryale, Mistral Nemo, or similar instruction-tuned chat models on Hugging Face. The r/LocalLLaMA subreddit maintains current model recommendations.

Why does SillyTavern show "no models loaded"?

SillyTavern isn't a model — it's a chat frontend. It needs to be pointed at a model that's being served either locally (via KoboldCPP, Oobabooga, Ollama, or similar running on your machine) or via a hosted API (Claude, GPT, Gemini). If you see "no models loaded," you haven't configured which model server SillyTavern should connect to.

What's the easiest hosted AI girlfriend?

[Sloane](/) is one option — 15 minutes from signup to chatting with a curated persona. Candy AI is another popular choice. Try a couple for a month before committing; flat monthly pricing ($10-30/mo) makes experimentation cheap, and the right fit depends on your specific preferences.

Can I run a local AI girlfriend on a laptop?

Yes, with caveats. Text generation (the chat side) runs on most modern laptops with 8GB+ RAM, though you'll be limited to smaller models (7B parameters or less). Image generation (the photos side) usually requires a GPU with at least 8GB VRAM, which most laptops without dedicated gaming GPUs don't have. Expect text to work and images to be slow or impossible without a desktop or high-end gaming laptop.

Is Ollama an AI girlfriend?

No. Ollama is a model runner — it downloads and runs AI language models on your computer, nothing more. For an AI girlfriend experience you also need a chat UI (SillyTavern), persistent memory, image generation of her, and glue code tying it all together. See [What Ollama actually is](/guides/ollama-ai-girlfriend-what-youre-missing) for the full gap.

How much does a local AI girlfriend cost to set up?

$0 in software (all tools are free and open-source) plus hardware investment: $800-2500 for a capable GPU if you don't already have one, plus the computer around it. Add 20-60 hours of setup time to assemble the stack. For users who already own gaming PCs with modern GPUs, the marginal cost is low; for users who need to buy hardware specifically for this, it's a real investment.

Can I use ChatGPT or Claude for an AI girlfriend?

Yes but with limits. Both OpenAI and Anthropic's content policies are stricter than purpose-built AI companion apps. You can set up a persona through system prompts, but the model will defer to policy on content categories hosted companion apps handle without friction. SillyTavern + API key is the usual way to use them in a chat-companion workflow; it's one path but not the easiest.

Why do hosted AI companion apps charge monthly?

Because they run the AI model on their servers, which costs real compute money per message. Flat monthly pricing shifts that per-message cost into a predictable subscription for users. Local setups move the compute cost to you (your hardware, your electricity, your maintenance time) — different tradeoff on the same underlying math.

Popular starting picks

Meet one of them free — no signup.

Mel
Mel, 26Sweet talk, sharper game.
Chat →
Gabriella
Gabriella, 34Fiery charm, impossible to resist.
Chat →
Helen
Helen, 23Sunlit soul with wanderlust vibes.
Chat →

KEEP READING

Characters

Comparisons

Guides

Recently shipped