Android · 2025 · Snapdragon 8 Elite
Local AI on the OnePlus 13
16 GB OxygenOS flagship. One of the rare phones where Qwen 3 8B Q4 is a realistic on-device pick.
- Advertised RAM
- 16 GB
- Usable for a model
- ~8.2 GB
- Compute
- Vulkan
- LM Mini path
- GGUF / Vulkan
Start in LM Mini
Install the app, pick one of these, chat offline.
Frontier feel on-device for high-RAM phones and M-series Macs.
Qwen 3 4B Instruct 2507 Runs well · ~2.4–2.5 GBBalanced daily driver for Pro phones and Macs — quality without a desktop GPU.
Gemma 3 4B Instruct Runs well · ~2.7–3.7 GBGoogle’s mid-size Gemma 3 — sharper answers; some builds can look at images.
Phi-4 Mini Instruct Runs well · ~2.3–2.4 GBStrong reasoning in a phone-friendly package — great for explanations and code-ish help.
Get LM Mini and load a model that actually fits — on-device, or via Connect to a PC.
What actually fits
Q4 weights plus KV cache. “Tight” means close Chrome first.
| Model | Params | Q4 | Here | Where |
|---|---|---|---|---|
| Qwen 3 0.6B | 0.6B | ~400–500 MB | Runs well | In LM Mini |
| Gemma 3 1B Instruct | 1B | ~700–750 MB | Runs well | In LM Mini |
| Llama 3.2 1B Instruct | 1B | ~700–808 MB | Runs well | In LM Mini |
| DeepSeek R1 Distill 1.5B | 1.5B | ~1.0–1.1 GB | Runs well | In LM Mini |
| Qwen 3 1.7B | 1.7B | ~1.1–1.2 GB | Runs well | In LM Mini |
| Llama 3.2 3B Instruct | 3B | ~1.9–2.0 GB | Runs well | In LM Mini |
| Phi-4 Mini Instruct | 3.8B | ~2.3–2.4 GB | Runs well | In LM Mini |
| Qwen 3 4B Instruct 2507 | 4B | ~2.4–2.5 GB | Runs well | In LM Mini |
| Gemma 3 4B Instruct | 4B | ~2.7–3.7 GB | Runs well | In LM Mini |
| Qwen 3.5 0.8B | 0.8B | ~500–600 MB | Runs well | Studio / Ollama |
| SmolLM2 1.7B Instruct | 1.7B | ~1.0 GB | Runs well | Studio / Ollama |
| Qwen 2.5 1.5B Instruct | 1.5B | ~1.0 GB | Runs well | Studio / Ollama |
| Qwen 3.5 2B | 2B | ~1.3–1.5 GB | Runs well | Studio / Ollama |
| Gemma 3n E2B | 2B | ~1.5 GB | Runs well | Studio / Ollama |
| Gemma 4 E2B Instruct | 2.3B | ~1.4–1.8 GB (Q4/QAT) | Runs well | Studio / Ollama |
| Qwen 2.5 3B Instruct | 3B | ~1.9 GB | Runs well | Studio / Ollama |
| SmolLM3 3B | 3B | ~1.9 GB (Q4) | Runs well | Studio / Ollama |
| Nemotron 3 Nano 4B | 4B | ~2.5 GB (Q4) | Runs well | Studio / Ollama |
| Qwen 3.5 4B | 4B | ~2.5–2.8 GB | Runs well | Studio / Ollama |
| Gemma 3n E4B | 4B | ~2.6 GB (Q4) | Runs well | Studio / Ollama |
| Gemma 4 E4B Instruct | 4.5B | ~2.6–3.2 GB (Q4/QAT) | Runs well | Studio / Ollama |
| Mistral 7B Instruct | 7B | ~4.1 GB (Q4) | Runs well | Studio / Ollama |
| OLMo 3 7B Instruct | 7B | ~4.3 GB (Q4) | Runs well | Studio / Ollama |
| Qwen 2.5 7B Instruct | 7B | ~4.4 GB (Q4) | Runs well | Studio / Ollama |
| Qwen 3 8B | 8B | ~4.7–4.9 GB | Fits | In LM Mini |
| Llama 3.1 8B Instruct | 8B | ~4.7 GB (Q4) | Fits | Studio / Ollama |
| DeepSeek R1 Distill 8B | 8B | ~4.7 GB (Q4) | Fits | Studio / Ollama |
| Hermes 3 8B | 8B | ~4.7 GB (Q4) | Fits | Studio / Ollama |
| Nemotron Nano 9B v2 | 9B | ~5.2 GB (Q4) | Fits | Studio / Ollama |
| Qwen 3.5 9B | 9B | ~5.2–5.6 GB (Q4) | Fits | Studio / Ollama |
| Gemma 2 9B Instruct | 9B | ~5.4 GB (Q4) | Fits | Studio / Ollama |
Too big for this phone
Host these on LM Studio or Ollama, then chat from OnePlus 13.
- Gemma 3 12B Instruct — PC + Connect
- Qwen 3 14B — PC + Connect
- Gemma 3 27B Instruct — PC + Connect
- Qwen 3 32B — PC + Connect
- Gemma 4 12B Instruct — PC + Connect
- Qwen 2.5 14B Instruct — PC + Connect
How we score this
OnePlus 13 ships with 16 GB. After Android we budget ~8.2 GB for inference. A 7B Q4 is ~4.4 GB on disk and wants ~6.5 GB live — that is why it fails on most 8 GB phones. 12–16 GB Android can try 8B. Apple 8 GB phones should live in 1B–4B.