Bidirectional SAM2 Tracking for Video Inpainting in ComfyUI

Bidirectional SAM2 Tracking for Video Inpainting in ComfyUI โ€” on a 16GB Laptop GPU

A local, open-source pipeline for replacing a subject’s head in a moving video shot, and the SAM2 patch that makes bidirectional mask tracking possible.

A few months ago I published an open-source project on GitHub: ComfyUI-Bidirectional-SAM2-Inpaint. It is an automated video inpainting pipeline built on ComfyUI, combining Wan 2.1 VACE, SAM2 and Qwen2.5-VL, designed to process long shots on limited hardware โ€” the reference machine is a laptop with a 16GB RTX 3080. This post documents how the pipeline works, why the SAM2 tracker had to be patched to propagate in both directions, and the workflow practices that determine the quality of the result.

ARTIST TALK โ€” LIQUID HORIZONS

ARTIST TALK โ€” LIQUID HORIZONS
๐Ÿ“ f|x|r galรฉria, Veszprรฉm, Vรกr โ€“ Foton udvar
๐Ÿ—“ Saturday, July 18 ยท 7 PM


This Saturday I’ll be talking about Liquid Horizons โ€” the immersive four-wall panoramic installation currently on view at f|x|r galรฉria โ€” and the process behind it: AI-generated imagery, projection, and the shifting horizon between the real and the synthetic image.


Can’t make it in person? Step into the virtual gallery here:
๐ŸŒŠ https://liquid.ivo3d.com

Join us โ€” the conversation is open to everyone.
Event details: https://www.facebook.com/events/1702583830854832/

I generated an audio companion โ€” a scene-by-scene author’s narration on the ideas behind the work.
“The machine writes and reads everything now; understanding is still ours.”
Listen below
๐ŸŽง HU:

๐ŸŽง EN:

๐ŸŽง DE:

See you there…

Tessela is now online โ€” try the installation in your browser

The real-time light installation Tessela is currently on view at Perceptual Spaces โ€” Hommage ร  Vasarely by Light, a group exhibition of the Lighthouse Association and guest artists at m21 Gallery in Pรฉcs (2 July โ€“ 23 August 2026), opened during the Zsolnay Light Festival โ€” in the year of Victor Vasarely’s 120th anniversary, in the city where he was born.

Tessela is a homage to Vasarely’s Vega period: a projected, tessellated field that behaves like a membrane rather than a grid. Five generative scenes are rendered live in WebGL2, and the image is never fixed โ€” in the gallery an infrared camera senses the viewer’s presence, and the field bends, breathes and deepens in response. The picture only exists together with the person looking at it.

And now you don’t have to travel to Pรฉcs to look: the web version of the installation is live at tessela.ivo3d.com. All five scenes run in your browser โ€” explore them with your mouse or touch, or enable your webcam and let your movement shape the image, just as it does in the gallery (everything is processed locally, nothing is recorded). Find the hidden menu, and let the field respond to you.

Tessela – 2D version

‘Tessela’ – difraction version (hommage รก Vasarely: Vega series, p5js version of the interactivity)

‘tessela’ – searchlight version

f|x|r 3D-Gallery-view

Just a quick minisite release for the upcoming (Liquid-horizons) exhibition at f|x|r gallery:
(3d teaser)

liquid.ivo3d.com

and a new article at kultura.hu