Screenpipe logoscreenpipe

Apple Intelligence now runs inside Screenpipe

3 min read
apple-intelligencelocal-aiscreenpipeprivacyon-device-ai

Apple Intelligence now runs inside Screenpipe

Your Mac already sees everything you do. Now it understands it.

We plugged Apple Intelligence directly into Screenpipe. Your screen recordings, meeting transcripts, and browsing history — all analyzed by AI running on your Apple Silicon chip. Nothing leaves your device. Ever.

apple intelligence × screenpipe

your screen → on-device AI → daily summary

everything processed on your Apple Silicon. nothing leaves your device.

screen capture
recording
9:15 AM🎥
Zoom

Team standup — discussed sprint priorities

capturing...
ai summary
apple silicon
waiting for data...
Processing
On-device
Data sent to cloud
Zero
Latency
< 2 seconds
Works offline
Yes

"What did I work on today?"

That's the question. You finish a long day — meetings, emails, Slack, code, research — and you can barely remember what happened at 10am.

Screenpipe remembers everything. And now Apple Intelligence turns that raw memory into something useful:

  • Daily summaries — a structured recap of your entire day, generated in seconds
  • Action items — extracted from meetings, emails, and messages you might have missed
  • Reminders — deadlines and commitments surfaced before you forget them
  • Instant search — "what was that API endpoint?" or "what did Sarah say about the budget?"

All processed on your M-series chip. No API keys. No monthly bill. No data leaving your machine.

apple intelligencelocalhost:3030
you
what did I work on today?

How it actually works

We built Screenpipe's AI as an OpenAI-compatible API. That means any tool that works with Claude can now use Apple Intelligence instead — just point it to localhost:3030.

your app / AI client
Claude, Cursor, any OpenAI client
screenpipe server
OpenAI-compatible API (Rust/Axum)
apple intelligence
Foundation Models framework (Swift FFI)
apple silicon
M1/M2/M3/M4 neural engine

Claude Desktop, Cursor, or any AI client can use your on-device model as a drop-in replacement. Streaming, tool calling, structured JSON — it all works.

# Ask about your day — processed entirely on your Mac
curl http://localhost:3030/ai/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "apple-intelligence",
    "messages": [{"role": "user", "content": "what did I work on today?"}]
  }'

Why this changes everything

Your screen data is sensitive. Passwords, financial info, personal messages, medical records, work secrets — it's all on your screen. Sending that to cloud AI? No thanks. Apple Intelligence processes it on-chip.

It's free. No per-token pricing. No $20/month AI subscription for processing. Apple Intelligence is included with your Mac. Screenpipe is open source.

It works offline. Plane, cabin, spotty wifi — doesn't matter. Your AI memory works everywhere your Mac does.

It's fast. No network roundtrip. 1-2 second responses, consistently. No rate limits, no outages, no "we're experiencing high demand."

For the curious

The integration is fully open source — 16,600+ GitHub stars. We wrote a Swift bridge to Apple's Foundation Models framework, compiled it into Screenpipe's Rust core via FFI, and exposed it as an OpenAI-compatible endpoint. The framework is weak-linked so Screenpipe still runs perfectly on older macOS versions.

Code lives in crates/screenpipe-apple-intelligence/.

What's next

  • Windows AI — same on-device processing, coming to Windows
  • Proactive insights — AI surfaces patterns before you ask
  • Weekly reviews — auto-generated summaries of your entire week

Try it

Download Screenpipe, enable Apple Intelligence on macOS 26+, and your screen data stays yours — understood by AI that never phones home.