Speech-Driven Visitor Notification System Using Telegram Bot and Voice Activity Detection for Real-Time Retail Applications

Aria Setiaji; Aria Hendrawan; Bernadus Very  Christioko; Lenny Margaretta  Huizen

doi:10.63158/IJAIS.v2i2.44

Authors

Aria Setiaji Universitas Semarang Author
Aria Hendrawan Universitas Semarang Author
Bernadus Very Christioko Universitas Semarang Author
Lenny Margaretta Huizen Universitas Semarang Author

DOI:

https://doi.org/10.63158/IJAIS.v2i2.44

Keywords:

Speech-to-Text, Telegram Bot, Voice Activity Detection, Retail Automation, Real-Time Notifications

Abstract

In the retail industry, fast and responsive service is essential for maintaining customer satisfaction and loyalty. A key challenge faced by store owners is delayed responses to customer arrivals, leading to dissatisfaction and potential lost sales. This project develops an automatic notification system using Speech-to-Text technology and a Telegram bot to detect voice keywords and send real-time notifications to store owners. The system was developed using the prototype methodology, allowing for iterative testing and refinement to ensure it met user needs and functional requirements. It integrates the Deepgram API for accurate speech transcription, the Telegram Bot API for notifications, and a web interface for managing keywords and monitoring system status. To enhance efficiency, a Voice Activity Detection (VAD) module was added, ensuring that only human speech is processed, thereby reducing unnecessary processing. Experimental results showed that the system achieved 100% accuracy in quiet environments and 80% in noisy conditions. The system's response time was also impressive, with an average time of 3.72 seconds in quiet conditions and 3.8 seconds in noisy environments. Word Error Rate (WER) and Character Error Rate (CER) evaluations indicated perfect accuracy in quiet conditions (WER 0%, CER 0%) and slight errors in noisy conditions (WER 13.33%, CER 12.5%). Overall, the system effectively improved service speed and responsiveness, offering store owners a valuable tool for enhancing customer experience in retail environments.

References

R. Hamid, D. L. Radji, and Y. L. Ismail, "Oikos-Nomos: Jurnal Kajian Ekonomi Pengaruh Empathy dan Responsiveness Terhadap Minat Kunjungan Ulang Pelanggan," Oikos-Nomos: Jurnal Kajian Ekonomi, vol. 5, no. 1, pp. 23-34, 2020.

F. R. Sinay, R. Facey, and G. Rehatta, "Pengaruh Tata Letak Produk Terhadap Keputusan Pembelian Pada Minimarket Alfamidi Depok Lima Desa Poka Kecamatan Kota Ambon," Jurnal Ilmiah Manajemen, vol. 12, no. 1, pp. 67-81, 2024.

A. H. Pratama Subakti, A. M. Hara Pardede, and M. A. Syari, "Rancangan Sistem Notifikasi Kedatangan Pembeli Dengan Suara Menggunakan Arduino," Jurnal Teknologi dan Sistem Informasi, vol. 10, no. 1, pp. 45-58, Jan. 2023.

M. Salman Farizi et al., "Implementasi Speech Recognition Pada Sistem Kendali Perangkat Elektronik Rumah Berbasis IoT (Internet of Things) dan Mobile Application," Jurnal Teknologi Informasi, vol. 15, no. 3, pp. 112-121, 2022.

H. Wijaya, "Teknologi Pengenalan Suara tentang Metode, Bahasa dan Tantangan: Systematic Literature Review," bit-Tech, vol. 7, no. 2, pp. 533–544, Dec. 2024, doi: 10.32877/bt.v7i2.1888.

Z. Ardila Safitri, E. Haerani, R. Muzawi, M. Affandes, and Pizaini, "Intrusion Detection System (IDS) Pada Snort Dengan Bot Telegram Sebagai Sistem Notifikasi Terhadap Serangan Syn Flood dan Ping Of Death," Jurnal Keamanan Siber, vol. 18, no. 2, pp. 76-84, Jun. 2024.

R. A. Darmawan, M. Ulfah, and A. S. Irtawaty, "Sistem Keamanan Kotak Amal Berbasis NodeMCU Menggunakan Bot Telegram," Jurnal Teknik Elektro dan Komputasi (ELKOM), vol. 5, no. 1, pp. 28–37, Mar. 2023, doi: 10.32528/elkom.v5i1.9370.

S. Prasetyo and S. Abdullah, "Rancang Bangun Penyiram Tanaman Otomatis Berbasis Internet of Things Menggunakan NodeMCU dan Telegram," Jurnal Restikom: Riset Teknik Informatika dan Komputer, vol. 3, no. 2, pp. 51–59, 2021.

A. F. Muhammad, "Developing Dataset Management of Speech Recognition Based Automatic English-Speaking Skill Testing System," Journal of Educational Sciences, vol. 7, no. 2, pp. 296-305, Apr. 2023, doi: 10.31258/jes.7.2.p.296-305.

D. Naufal Kurozy, R. Gilang Pratama, and A. E. Muhammad, "Penerapan Metode Prototype Pada Perancangan Sistem Pendaftaran Mahasiswa Baru," Jurnal Pustaka Nusantara Multidisplin, vol. 3, no. 1, pp. 45-59, 2025.

N. Renaningtias and D. Apriliani, "Penerapan Metode Prototype Pada Pengembangan Sistem Informasi Tugas Akhir Mahasiswa," Jurnal Rekursif, vol. 9, no. 1, pp. 101-112, 2021.