- Don't forget about entropy! You've just created two identical copies of all of your random number generators, which could be very very bad for security.
The firecracker team wrote a very good paper about addressing this when they added snapshot support.
- It's so frustrating seeing all this sandbox tooling pop up for linux but windows is soooooo far behind. I mean Windows Sandbox ( https://learn.microsoft.com/en-us/windows/security/applicati... ) doesn't even have customizable networking white lists. You can turn networking on or off but that's about as fine grained as it gets. So all of us still having to write desktop windows stuff are left without a good method of easily putting our agents in a blast proof box.
- Really impressive work. Sub-millisecond cold starts via CoW forking is a pretty clever approach.
The tricky part we keep running into with agent sandboxes is that code execution is just one piece, bcs agents also need file system access, memory, git, a pty, and a bunch of other tools all wired up and isolated together. That's where things get hairy fast.
- Nice to see this work! I experimented with this for exe.dev before we launched. The VM itself worked really well, but there was a lot of setup to get the networking functioning. And in the end, our target are use cases that don't mind a ~1-second startup time, which meant doing a clean systemd start each time was easier.
That said, I have seen several use cases where people want a VM for something minimal, like a python interpreter, and this is absolutely the sort of approach they should be using. Lot of promise here, excited to see how far you can push it!
- I noticed that you implemented a high-performance VM fork. However, to me, it seems like a general-purpose KVM project. Is there a reason why you say it is specialized for running AI agents?
- Does it only work with that specific version of firecracker and only with vms with 1 vcpu?
More than the sub ms startup time the 258kb of ram per VM is huge.
- Niiiiiice, I've been working on something like this, but reducing linux boot time instead of snapshot restore time; obviously my solution doesn't work for heavy runtimes
by indigodaddy
1 subcomments
- Your write-up made me think of:
https://codesandbox.io/blog/how-we-clone-a-running-vm-in-2-s...
Are there parallels?
- Is this a service or a library? The README has curl and an API key... Can I run this myself on my own hardware?
by indigodaddy
1 subcomments
- Does this need passthrough or might we be able to leverage PVM with it on a passthrough-less cloud VM/VPS?
- The tricky part of doing this in production is cloning sandboxes across nodes. You would have to snapshot the resident memory, file system (or a CoW layer on top of the rootfs), move the data across nodes, etc.
- Is it possible to run minikube inside ? I’d love to use it for ephemeral clusters for testing .
- Similar to sprites.dev?
- Any plans to offer self-hosted / open-source version?
by quickrefio
0 subcomment
- Feels like fork() but for VMs—very cool.
by buckle8017
1 subcomments
- This is how android processes work, but it's a security problem breaking some ASLR type things.
by yagizdagabak
2 subcomments
- Cool approach. Are you guys planning on creating a managed version?
- super clever and awesome!
- Nice.
Now I want the ability to freeze the VM cryogenically and move it to another machine automagically, defrosting and running as seamlessly as possible.
I know this is gonna happen soon enough, I've been waiting since the death of TandemOS for just this feature ..
by jauntywundrkind
2 subcomments
- I keep so so so many opencode windows going. I wish I had bought a better SSD, because I have so much swap space to support it all.
I keep thinking I need to see if CRIU (checkpoint restore in userspace) is going to work here. So I can put work down for longer time, be able to close & restore instances sort of on-demand.
I don't really love the idea of using VMs more, but I super love this project. Heck yes forking our processes/VMs.
by handfuloflight
2 subcomments
- Can you run this in another sandbox? Not sure why you'd want to... but can you?
by justboy1987
0 subcomment
- [dead]
by olivercoleai
0 subcomment
- [dead]
- [dead]
- [dead]
by jauntywundrkind
1 subcomments
- Mods: can we merge with https://news.ycombinator.com/item?id=47412812?
by Jeffrin-dev
0 subcomment
- [flagged]
- [flagged]
Hacker News