In this article, I’m going to share my experience building an interruptible voice runtime on an NVIDIA Jetson Orin Nano. The goal of this project was to create a system that can handle voice commands in real time, with the ability to interrupt ongoing processes based on user input. The user presses a button and says a voice command like “Turn right”, voice activity detection (VAD) detects the speech, Whisper transcribes the utterance on the GPU, and a JSON command with a latency breakdown is emitted. I use a closed grammar with a small set of commands, so the transcribed text is matched against the grammar to determine the intent.