Nodes

AI Mask

Mask anything in the shot by describing it in words.

Finds things by name and tracks them through the shot. Takes Image Sequence, outputs Mask Frames.

First-Time Setup

Two one-time downloads, and the node asks for them in order.

Install AI Runtime is about 2 GB of PyTorch and friends. Restart Blender when it finishes, because the runtime can't load into a session that started without it.

Download AI Model is about 900 MB.

Nothing downloads until you press these buttons.

Prompt

What to look for, with multiple things separated by periods:

person. car
red bag

Singular words beat plurals. Commas are converted to periods for you.

Detection Type

Single frame detects on one anchor and propagates from there. Right most of the time. Leave Current Frame ticked to follow the playhead.

Multi frame takes several anchors, typed as numbers or added with Add Current Frame. Use it when the subject enters late, gets occluded, changes appearance, or the shot is long enough to drift. Up to 32.

Thresholds

Box Threshold is detection confidence. Lower catches more and risks false positives, higher is stricter. Text Threshold is how closely something must match your words. Both start at 0.25; move them 0.05 at a time.

Max Boxes caps how many separate things get masked.

Dilate/Erode

Grows the mask with positive values, shrinks it with negative, in pixels.

Grow it when masking for a solve. A mask that stops at the silhouette still leaves the subject's edge pixels, which are exactly what a tracker grabs. Five to fifteen pixels usually does it.

The preview updates live as you drag, but the value is baked into generated files, so regenerate after changing it.

Buttons

Preview Mask renders one frame with the mask tinted over it. Fast, and the right way to get your prompt right before committing.

Generate Masks runs the whole sequence.

Load Existing Masks picks up matching masks generated earlier instead of running again.

Downstream

Feeding Auto Track gives you a Mask Mode choice there: exclude what the mask covers, or use only what it covers.