Audio-to-Tactile Representation

(This is not an official Google product.)

Audio-to-Tactile is a project about audio-to-tactile representations. We developed a wearable tactile device that aims to enables users to feel sound in a natural and useful way, especially in understanding speech and complementing lip reading.

If you are interested and have ideas about using our hardware or want to receive updates, please fill out this form.

Slim v0.4 bracelet

Live web demo (click to open)

License

This code uses the Apache License 2.0. See the LICENSE file for details.

Documentation

• Hardware
• Firmware
• Mechanical
• Android app
• Signal processing
  • Energy envelope
  • Frontend
  • Vowel embedding
  • References
    • TAPS
    • Bratakos et al. 2001
    • Yuan et al. 2005
• Perceptual measurements
• Tools
  • flash_firmware
  • play_buzz
  • Tactometer

Mailing list

[email protected]