Litestream Writable VFS

I need to bring writes to my version of the VFS.

I'm still waiting on how they'll prevent accidental corruption from multiple writers; there's a PR implementing write leases, not sure if that's the direction they'll take.

That said, pausing local polling when writes are enabled - i.e. assuming you're the only writer - makes sense, it's a good idea; hadn't occurred to me.

Ideally, I'd like to offer durability on fullfsync. I think this is feasible. In a concurrent system (single host), while a writer is waiting for durability confirmation, readers can continue reading the previous state, and the next writer can read the committed - but not yet durable - data and queue its writes to be batched. You can have as many pending writes as you're willing to have connections.

I wonder how this compares to running sqlite off of an s3-backed ZeroFS https://github.com/Barre/ZeroFS

I glad this got re-upped, I was sad there wasn't much (any?) discussion when this was posted a few days ago.

I find the ways people extend or build on top of Sqlite to be fascinating. I use it in a few apps but not on the server (yet). Multi-writer for something like would be amazing (incredibly difficult to do well, obviously). I work on a home-rolled distributed database (multi-writer) but it has numerous downsides/issues so I love seeing how other people approach and solve these things.

- anyone knows what is the equivalent of litestream for postgres? - i want to be able to pg_dump and barman my database to s3 by streaming it. is that possible?

I love litestream. I've used it with pocketbase and it works. sqlite is a great building block for almost everything.

Does anyone know whether you could use this to stitch together a bunch of .db files (that share the same schema) in an ad-hoc way?

For example, if I decided I wanted to synchronize my friend's .db file, could I enable this using litestream? And, what if my friend wanted to sync two of his friends' .db files, but I'm only interested in his changes, not theirs? I assume this kind of fan out is not possible, but it would be fun if so.

I’m a hobbyist who doesn’t have any s3-compatible storage. (That I know of, anyway.) What’s the easiest way to try it out?

> We recently unveiled Sprites. If you don’t know what Sprites are, you should just go check them out. They’re one of the coolest things we’ve ever shipped.

Been about two weeks now since the linked article was published.

Hey fly, what are the internal usage numbers on "sprites"?

Is anyone using them? To do what? Worth the effort?

[sorry for the weird timestamps - the OP was submitted a while ago and I just re-upped it and it hit a dumb bug which I haven't gotten around to fixing yet]