Sonavi is a sound detection system that alerts Deaf and Hard of Hearing users to environmental sounds through customizable smartwatch vibrations. We harness the power of on-device machine learning to detect and classify sounds captured by a Wear OS smartwatch, process them on an Android mobile device, and deliver haptic feedback—all without requiring an internet connection.

We implemented the YAMNet audio classification model using LiteRT (formerly TensorFlow Lite) for real-time sound detection