Can I run a local LLM on iPhone 13 Pro?

Yes, at the right size. iPhone 13 Pro has about 2.4 GB usable. Try Qwen 3 1.7B, DeepSeek R1 Distill 1.5B, Gemma 3 1B Instruct in LM Mini. Bigger models belong on a PC via Connect.

How much RAM does iPhone 13 Pro really have for AI?

6 GB advertised, ~2.4 GB left for weights + KV cache. That is why 7B Q4 fails on many 8 GB phones.

iPhone / iPad · 2021 · A15

Local AI on the iPhone 13 Pro

Still a capable local box if you stay at 1B–1.7B. Older thermal envelope — shorter sessions.

Advertised RAM: 6 GB
Usable for a model: ~2.4 GB
Compute: Metal / ANE
LM Mini path: MLX / Metal

Start in LM Mini

Install the app, pick one of these, chat offline.

Qwen 3 1.7B Fits · ~1.1–1.2 GB

Best everyday phone pick for most people — chat, tools, and general help.

DeepSeek R1 Distill 1.5B Fits · ~1.0–1.1 GB

A mini “thinking” model — stronger at math and step-by-step reasoning.

Gemma 3 1B Instruct Fits · ~700–750 MB

Google’s smallest Gemma 3 chat model. Great starter for everyday questions.

Llama 3.2 1B Instruct Fits · ~700–808 MB

Meta’s pocket Llama — fast, tool-friendly, and solid for light chat.

Get LM Mini and load a model that actually fits — on-device, or via Connect to a PC.

App Store Google Play Mac & more

What actually fits

Q4 weights plus KV cache. “Tight” means close Chrome first.

Model	Params	Q4	Here	Where
Qwen 3 0.6B	0.6B	~400–500 MB	Fits	In LM Mini
Gemma 3 1B Instruct	1B	~700–750 MB	Fits	In LM Mini
Llama 3.2 1B Instruct	1B	~700–808 MB	Fits	In LM Mini
DeepSeek R1 Distill 1.5B	1.5B	~1.0–1.1 GB	Fits	In LM Mini
Qwen 3 1.7B	1.7B	~1.1–1.2 GB	Fits	In LM Mini
Qwen 3.5 0.8B	0.8B	~500–600 MB	Fits	Studio / Ollama
SmolLM2 1.7B Instruct	1.7B	~1.0 GB	Fits	Studio / Ollama
Qwen 2.5 1.5B Instruct	1.5B	~1.0 GB	Fits	Studio / Ollama
Qwen 3.5 2B	2B	~1.3–1.5 GB	Tight	Studio / Ollama

Too big for this phone

Host these on LM Studio or Ollama, then chat from iPhone 13 Pro.

How we score this

iPhone 13 Pro ships with 6 GB. After iPhone / iPad we budget ~2.4 GB for inference. A 7B Q4 is ~4.4 GB on disk and wants ~6.5 GB live — that is why it fails on most 8 GB phones. 12–16 GB Android can try 8B. Apple 8 GB phones should live in 1B–4B.