REALTIME FACIAL INPUT

Face as signal.

Smile creates tone. Frown creates noise. Facial gestures and microphone input remain available independently.

DisconnectedWaiting for input

FIG. 001 / FACIAL MOTIONKEY ANO SOURCE

CIRCLE OF FIFTHS

VOICE + FACE → SOUND + PARTICLES-- FPS

Input

01 / SOURCE

Move the controls to test the face without an iPhone.

Jaw open 0.00 Smile left 0.00 Smile right 0.00 Frown left 0.00 Frown right 0.00 Blink left 0.00 Blink right 0.00 Brow raise 0.00 Head yaw 0° Head pitch 0° Eye yaw 0°

On your Mac, double-click Start Facial Ambient.command in the portfolio folder. Keep iFacialMocap open on the iPhone.

node receiver/facial-receiver.js --bluetooth node receiver/facial-receiver.js --iphone 192.168.x.x

Sound

02 / VOICE + FACE

Sound off

Facial inputUse Smile–Sad or Gesture mode below Microphone inputVoice level → separate note density

EXPRESSION MAPPING

Above each threshold, density rises in steps of 1 note per second. Smile adds Tonal notes. Frown adds lower Noise and harmonic-minor colour. Head turns still change the key and play bass. Frozen face input sets facial density to zero.

SMILE → TONAL

0% · 0/s

Smile threshold 25% Smile max density 6 / sec

FROWN → NOISE

0% · 0/s

Frown threshold 30% Frown max density 6 / sec

MINOR COLOUR

MIC INPUT

0.0%

TRIGGER

MICROPHONE MAPPING

Mic trigger threshold 1.2% Mic max density 12 / sec Mic density curve 1.4 Mic rise 350 ms Mic fall 800 ms Mic Tonal probability 21%

Signal monitor

03 / DEBUG

Receiver rate--

Browser rate--

Changed frames--

Draw rate--

Last update--

Bridge → draw--

Stream gaps--

Current keyA

Bridge → draw starts when the browser receives a frame. iPhone capture and network delay are not included.

Head rotation

DEGREES

X 0.0° · Y 0.0° · Z 0.0°

Eye rotation

DEGREES

L 0, 0, 0° · R 0, 0, 0°

BlendShapes

0 CHANNELS