Chat with Screenshot
Take a screenshot, run this shortcut, and chat about what's in the image. LM Mini extracts text via OCR and answers questions about the content.
One-tap install
Build the shortcut below (2 minutes), then share to iCloud from Shortcuts.app to enable one-tap install for others. Update website/data/shortcuts.json with your icloudUrl and re-run this generator.
Siri Phrase
"Hey Siri, chat about this screenshot"
Run once after installing, then Siri learns this phrase.
How the shortcut works
- Capture a screenshot (or pick from Photos).
- Run the shortcut — it extracts text from the image.
- Ask LM Mini a question about the screenshot content.
- Get insights, summaries, or translations of on-screen text.
Key features
- Combine Extract Text from Image with Ask LM Mini
- Works with vision-capable cloud providers in LM Mini Pro
- On-device OCR + local model for text-heavy screenshots
- Great for error messages, receipts, and slide decks
Recommended models
Use on-device for OCR text + Qwen 3 4B for Q&A
Vision models via cloud provider or LM Studio for image understanding
Tune temperature (0.7) and top-p (0.9) in LM Mini → Settings → Model Parameters. See the full on-device model catalog.
Build it in 60 seconds
- Add Select Photo or Get Latest Screenshots.
- Add Extract Text from Image.
- Ask LM Mini: Here is text from a screenshot. Answer my question about it. Text: [extracted]. Question: [Ask for Input].
- Show Result.
URL scheme (power users)
Add an Open URLs action in Shortcuts.app:
lmmini://shortcut/ask?prompt=Analyze%20screenshot%20text&onDevice=1Need LM Mini? Free on iOS and Android — on-device GGUF/MLX, LM Studio Connect, voice, and more.
Download LM Mini LM Mini vs Private LLM