earn $

πŸ“Ί screenpipe #001 | new things and what's next

2024-08-073 min read

screenpipe #001

⬇️ download mac m app
⬇️ download windows app
give us a ⭐️(814) to help the algorithm

hey everyone, matt and louis here

brain activity

this was us looking at each other's brain activity before starting screenpipe to check our compatibility, haha

now we record screens & mics instead of brains (though that could become a thing?)

btw, this is screenpipe newsletter, where we share new things, bug fixes, works in progress, and what's next. we're obsessed about bringing you the best experience possible, if you have any feedback, issues, anything, hit reply or book a call with us:

  • louis, eu timezone (for now)
  • matt, sf timezone

✨ what's new

πŸ”— integrations

last week matt won Friend wearable hackathon (it's a necklace with mic that records everything) and we've released an experimental integration, which would:

  • stream screenpipe data to their system
  • stream their data to ours (so you can ask "summarize all my conversations today," including IRL and online conversations)

friend integration

we're also working on integrations with:

  • MultiOn
  • Mem0.AI
  • frame by Brilliant Labs
  • phone integrations: Iphone/Android
  • Supermemory
  • and many more

example demo integration with Friend & Openglass wearable: we can query screenpipe through Friend using a trigger phrase like "Hey Friend, ...". in this example, the Openglass wearable recognizes the person in front of me, and I follow up with a query. here are the server logs:

demo logs

full demo: https://x.com/m13v_/status/1818129198474740079

however, the main integration we are finishing up is native text recognition (OCR) on Windows/MacOS. we already have something working, and the quality is much higher than with Tesseract running locally

but local models still have a lot of limitations, which we address with cloud options (βœ… already available):

  • πŸŽ™οΈ audio transcription through Deepgram
  • πŸ” OCR through Unstructured

they've proven to be the highest quality out there πŸ†, and we can overload their servers with as many requests as we want πŸ˜‚. thankfully, we have a ton of credits with them, so we can offer it at no extra charge 🎁.

πŸͺ² bug fixes

the app is still in alpha and we've fixed tons of bugs, however, we're releasing daily updates to fix them, along with new features. we're two person teem, but we have open source contributors joining, and we would be happy to welcome more! β˜ΊοΈπŸ™

links

take care,
matt, louis
screenpipe
ai that knows everything about you

follow us:
x
youtube
discord

wanna chat?

You are receiving this email because you opted-in to receive updates from Mediar, Inc
Mediar, Inc, 2 Marina Blvd B300, San Francisco, CA 94123