Nosmai Studio Add reactions and gestures
Nosmai Studio / Guides / Add reactions and gestures
Updated October 7, 2026

Make a filter respond to a face gesture in Nosmai Studio by adding a reaction: a blink, a wink, or the face appearing or leaving can reveal a material, play an animation, show a layer, or drive a shader. Reactions are configured in the Reactions strip under the stage and are how two of the three shipped templates come to life.

Overview

A reaction makes something in a filter respond to a face gesture: a blink reveals a material, a long blink plays an animation, the face leaving hides a layer. You set reactions up in the Reactions strip under the stage. They are the interactivity behind the Loki Magic (long-blink reveal) and BlinkFlyer (blink to play) templates.

Product: Nosmai Studio · Platform: macOS, Windows · Updated: 7 October 2026 · Reading time: 9 minutes

Prerequisites

  • A filter open in the editor, with something to react (a 3D model, a layer, or a shader pass).
  • To see a reaction fire, a device preview or a running preview with a face.

Add a reaction

  1. Open the Reactions strip under the stage, or press Add reaction.
  2. Choose what reacts: an object's material, a layer's visibility or opacity, an animation, a sequence, or a shader pass uniform.
  3. Choose the gesture that triggers it.
  4. The reaction appears in the Reactions strip, listed on the thing it belongs to.

The gestures you can use

A reaction fires on a face gesture or state. The signals the SDK feeds today:

GestureWhat it means
Blink (left or right)An eye closes. Used alone or combined
Long blinkBoth eyes held shut briefly
WinkOne eye closes while the other stays open
Face foundA face enters the view
Face lostThe face leaves the view

Some head-pose signals (face scale, head yaw, pitch, roll) are recognised by the SDK but not yet fed with live values, so a reaction bound to one of them does not fire. Studio marks those so you do not pick an inert trigger. Blink, wink, and the face found and lost events are the reliable ones.

What a reaction can do

The action a gesture triggers depends on what it is attached to:

Attached toThe reaction can
A 3D model's materialReveal, hide, or toggle the material
A layerShow or hide it, or change its opacity
An animationPlay it
A sequenceAdvance or control playback
A shader pass uniformDrive a float the pass declares, so the shader reacts

A shader reaction only works if the pass declares the float uniform the trigger writes to. If it does not, the SDK drops the trigger and the pass still renders, it just never reacts. Declare the uniform in the shader to fix it.

Test it

Most gestures are easiest to confirm on a device, where a real face drives them. See Preview on a device. In the running Studio preview, a gesture on the previewed face fires the reaction too.

Verify it worked

  • The reaction is listed in the Reactions strip, on the object it belongs to.
  • Performing the gesture (for example a blink) fires the reaction in the preview.
  • A shader reaction changes the pass only when the pass declares the bound uniform.

Common problems

What you seeWhyFix
The reaction never firesIt is bound to an unplumbed head-pose signalUse blink, wink, face found, or face lost instead
A shader reaction does nothingThe pass does not declare the bound float uniformAdd the uniform to the shader so the trigger has something to write
The gesture fires unreliablyBlink and wink detection need a clear, well-lit faceImprove lighting and face the camera directly
Nothing reacts in StudioThe gesture needs a face in the previewRun the preview with a face, or test on a device

Next steps

Reference

Nosmai

An AR and AI company. Founded on the idea that the next decade of software will be visual, and that the tools for it should be within reach of anyone building.

Newsletter

Product updates and release notes. No spam.

© 2026 nosmai, inc · all rights reserved