← All projects
AI

Stream Engineer

A local-first AI audio engineer that mixes your stream for you.

Stream Engineer

The problem

Live streamers have to ride a mixer mid-stream, balancing mic, game, and music by hand while also playing and talking.

The approach

Stream Engineer sits behind OBS and mixes for you. A C++ plugin taps real-time audio metrics, and a C#/.NET desktop app classifies each source and rebalances voice, game, and music as conditions change.

AI architecture

On-device ONNX models (Silero voice-activity detection) detect speech and classify sources in real time, locally, so mixing stays low-latency and private.

Highlights

  • ▹C++ OBS plugin captures live DSP metrics
  • ▹C#/.NET desktop app classifies each audio source and rebalances the mix continuously
  • ▹On-device ONNX models (Silero VAD) for low-latency, private voice detection
  • ▹Automatic mic calibration and source classification
  • ▹Targets a full stream with zero manual mixer changes