Running AI on your own computer — no cloud, no account, no data leaving your machine — sounds like hacker stuff. It’s not anymore. Running DeepSeek locally takes about 15 minutes with the right tool, and this guide walks you through every step.
Why Bother Running It Locally?
- Total privacy: Nothing you type ever leaves your computer. Ideal for sensitive work, journaling, or proprietary code.
- Works offline: Planes, remote areas, dead zones — your AI still works. (Unlike Gemini, which needs internet.)
- Free forever: No subscriptions, no per-token API bills. Your hardware is the only cost.
- No censorship surprises: You control the model. What you run is what you get.
The trade-off: quality and speed depend on your hardware. A beefy machine runs impressive models; an old laptop runs small-but-useful ones.
What You Need (Hardware)
- Minimum viable: 16GB RAM, any modern CPU. Runs smaller DeepSeek distill models (7B-8B) — good for basic chat, simple coding help.
- Comfortable: 32GB RAM or a Mac with Apple Silicon (M1+). The unified memory on MacBooks is genuinely excellent for local LLMs.
- Great: A dedicated GPU with 12GB+ VRAM (RTX 3060 and up). Fast, capable, handles larger models.
- Disk space: 5-50GB depending on model size. Models are big files — that’s normal.
Step-by-Step: Install with Ollama (Easiest)
- Install Ollama: Go to ollama.com and download for your OS (Windows, Mac, Linux). Install it like any normal app.
- Open your terminal (Terminal on Mac, PowerShell/CMD on Windows).
- Pull a DeepSeek model: Type
ollama pull deepseek-r1:8b(smaller, faster) orollama pull deepseek-r1:14b(smarter, needs more RAM). Wait for the download — it’s several GB. - Run it: Type
ollama run deepseek-r1:8b. You’re now chatting with DeepSeek in your terminal. That’s it. Really. - Get a nice interface (optional): Install Open WebUI for a ChatGPT-style interface in your browser. It connects to Ollama and feels like a real product.
Which DeepSeek Model Should You Pick?
- deepseek-r1:8b — best starting point. Reasoning-capable, runs on modest hardware.
- deepseek-r1:14b / 32b — noticeably smarter, needs 32GB+ RAM or a good GPU.
- deepseek-coder variants — if coding is your main use, these are tuned for it.
- Rule of thumb: pick the biggest model that runs at acceptable speed on your machine. A fast 8B beats a painfully slow 32B you’ll never use.
Tips for Good Results
- Keep prompts clear and specific. Smaller models need more guidance than frontier models — see prompting basics.
- It’s weaker at niche facts. Use local AI for reasoning, writing, and coding — verify facts elsewhere.
- Try quantized versions (Q4, Q8) if a model is slightly too big — they trade a little quality for a lot of memory savings.
- Close other heavy apps while running large models. Your RAM will thank you.
Going Beyond the Terminal: Better Interfaces
The terminal works, but you’ll use local AI far more with a proper interface:
- Open WebUI: the gold standard — ChatGPT-like interface, conversation history, file uploads, runs in your browser. Install via Docker; connects to Ollama in minutes.
- LM Studio: beginner-friendly desktop app — browse models, download, chat, all GUI. Great first step before Ollama.
- GPT4All: simple, lightweight, good model selection built in.
- AnythingLLM: if you want RAG (chat with your documents) locally — upload PDFs, ask questions, all offline.
Chatting With Your Documents (Local RAG)
The killer local-AI feature: private document Q&A. Upload your company’s docs, your research papers, your personal notes — ask questions, get answers with citations, nothing leaves your machine. AnythingLLM or Open WebUI with RAG makes this point-and-click simple. For sensitive documents that could never go to a cloud AI, this is transformative — it’s the privacy use case that justifies the whole setup.
Maintenance and Model Updates
- Update models occasionally:
ollama pullthe latest version every few months. Models improve; your local ones can too. - Try new models freely: pulling a model is free and fast. Experiment — you might find a new favorite.
- Clean up disk space:
ollama rm old-modelfor models you don’t use. They eat gigabytes. - Back up nothing: models are re-downloadable; your chats (in Open WebUI) are the only thing worth backing up.
And when you need the cloud’s extra muscle for a hard problem, you can always switch — local and cloud AI complement each other. For the privacy comparison, see how chatbot privacy policies differ.
Troubleshooting Common Setup Issues
Most installation problems fall into a few buckets. “Model not found”: check the exact model name with ollama list — typos are the #1 cause. Out of memory: your model is too big for your RAM; drop to a smaller variant (e.g., 8B instead of 14B) or a more aggressive quantization. Slow responses: normal on CPU-only machines for larger models — reduce model size or accept the pace for background tasks. Port conflicts: if Ollama won’t start, another service may hold port 11434; check and kill it. Weird outputs: try a different quantization or model version — some quants are buggy. The community forums for Ollama and llama.cpp are excellent; search your exact error message before despairing. And if local setup frustrates you, there’s no shame in the cloud — local is a choice, not a requirement. For Mac-specific guidance, see MacBooks and unified memory for local LLMs.
Bottom Line
How to run DeepSeek locally? Install Ollama, pull a model, run it — 15 minutes, zero cost, total privacy. Start with the 8B version, add Open WebUI for comfort, and upgrade model size as your hardware allows. It won’t replace ChatGPT for everything, but for private, offline, unlimited AI, nothing beats having the model on your own machine.
2 Comments