screenpipe #005

⬇️ download mac m app
⬇️ download windows app
give us a ⭐️(11.5k) to help the algorithm

hey louis & matt here

btw, in this newsletter, we share new features, bug fixes, work in progress, and what's next.

as a reminder, screenpipe is an open source library and an app to record data from your screens & mics and pass it into a llm. an ai powered by what you've seen, said, or heard:

✨ what's new

🧠 notion integration

we released an early version of a pipe that synchronize your meetings to Notion + automatically enrich the data using Notion's AI:

at the moment it's quite technical to run it, head to examples folder in github and you'll find it, we're going to make it usable even if you are non technical, feel free to share any ideas or tell us if it could be useful so we can prioritize

➕ add your own pipe from the app UI

the data that screenpipe collects contains extremely valuable information and that's why we want to make it frictionless for anyone to extend screenpipe and use what everyone else built on top

we added a way to add pipe from the app UI (or CLI) by just dropping the URL:

try to drop some of the pipe examples in the repo and you'll see the magic! (still a bit technical to understand what will happen, working on improving it)

🔈 use virtual devices in macos

you can now use virtual devices on macos, we currently recommend it to capture system audio, you can install Blackhole (google it) and create a multi-output device in your MIDI settings then you can select this device in screenpipe settings (or CLI)

this will both give you more control over the audio and less issues

🪲 bug fixes

• we did a lot of progress on memory issues (on all OSes) and still see some ways to improve it, if you see screenpipe is using too much memory you can:
  • restart
  • use deepgram transcription engine
  • disable audio if you don't need it (added to app settings)
  • try to change other parameters
• timezone improvements in AI prompts thanks to @ac3xx
• file encoding issues sometimes when the monitor have uneven size

🧗‍♂️ known issues & workaround

• on macos you need to remove and re-add screen capture permissions every time you update the app (will solve this soon)
• windows defender may delete screenpipe, please tame it down! this is false positive
• linux screencapture does not support wayland (in a few weeks), use X

🔮 what's next

we're building what you want the most (check discord pinned message, we did a poll asking for it):

• better stability & performance
• better search, more relevancy, less redundant information
• brand new local voice detection model & speech to text (silero)
• add new OCR engine (esp. for linux)
• more recording customization (filtering in/out specific apps/tabs)
• advanced security: mp4 encryption at rest
• reduce storage required by half using h265 encoding
• automatic audio device switch
• more productive UI (global shortcut, cursor-alike chat, shortcuts, etc.)
• easier to see your data from the app
• more customisable app AI settings (use your own openai api compatible URL)
• use native API (send desktop notification when a meeting end for example) & other high level abstraction in pipes

btw we're running bunch of paid bounties (up to $200 atm) to make screenpipe even better, just go to github issues and check issues with label "bounty"

• the app is still in alpha and we've fixed tons of bugs, however, we're releasing daily updates to fix them, along with new features. we're a two-person team, but we have open source contributors joining, and we would be happy to welcome more! ☺️🙏

links

• download mac m app
• download windows app

take care,
screenpipe

follow us:
x
youtube
discord

wanna chat?

You are receiving this email because you opted-in to receive updates from Mediar, Inc
Mediar, Inc, 2 Marina Blvd B300, San Francisco, CA 94123