Aug 28, 2026 · 2 min read

Which Models Run Well on Your Phone?

Which Models Run Well on Your Phone?

TL;DR: On-device models in LM Mini run on your phone, not in the cloud. Smaller quantized files, usually Q4, tend to feel best (just my honest opinion). Get Started gives you Faster, Balanced, or Best for your phone. The biggest download is not automatically the smartest on a phone.

You have a Persona and a voice now, so this one is what to actually put behind them, on-device models and how I test them.

I have watched people download the largest file they can find, then write in like the phone betrayed them. The phone did its best, it was also running the rest of their life, messages, maps, a dozen other apps. A model can look small on storage and still want a serious chunk of memory when it runs. Push it, and you get heat, a slow first token, a ridiculous response, or the chat falling over. That is not LM Mini being dramatic, that phone can only hold so much. (Drama is optional, in Personas, and your personal choice.)

Q4, the 4-bit ones, are what usually fit a phone. Of the three choices on Get Started, Best needs more RAM, and I pick Faster when I still want the rest of the phone to feel normal. A small model that answers quickly will help you more than a giant one that makes you wait. If I want more models, or a Hugging Face file, that comes with Pro.

Arena is where I put up to four of them on the same prompt and let them talk at once. One starts sooner, one writes something I would keep, and I can see that in one sitting instead of flipping back and forth. Creating the supreme ultimate Persona also depends on the AI model you’ve chosen for it. Feel like it’s still slightly off? Test a few models out and see how they respond.

For everyday stuff on the phone, a small on-device model is enough. If the work is long files or heavy coding, that belongs on a big desk model.

Next post is whether LM Studio needs internet. Until then, pick Faster or Balanced, download it, test it, and enjoy.

Get LM Mini: lmmini.com