Samurai: Adapting Segment Anything Model for Zero-Shot Visual Tracking
81 points by GordonS
by steinvakt2
0 subcomment
Note that this currently only enables single object tracking. Tried it for my research project (tracking cells on microscopic videos) but it didn't work well. Guess it's more suited for real world 3d scenarios
by IshKebab
2 subcomments
Very impressive. I wish research like this was more deployable. It always seems to come in the form of a muddy ball of Python, rather than e.g. a C++ or Rust library you could actually deploy in a product.
I get why, but it still seems a shame that there's all this cool ML research that will only make it into actual products in 10 years when someone with the resources of Adobe rewrites it in something other than Python.
by GordonS
0 subcomment
Full, unabridged title (which adds something important!):
"SAMURAI: Adapting Segment Anything Model for Zero-Shot Visual Tracking with Motion-Aware Memory"
It's the memory part that I find so impressive in the demo videos!
Hacker News