Deep learning, a subfield of machine learning, is a state-of-the-art technology that has possibilities to solve many problems in computer vision and natural language processing. In recent years, we have witnessed a rise in the application of deep learning models in audio processing, most of which, however, are limited to the music industry. Deep learning’s use cases in audio processing can be further expanded for businesses. This paper will focus specifically on how audio analysis leveraging deep learning can detect anomalous conversations in a call center record. Such a use case promises to help companies saves massive time, effort and cost in managing the quality of their helpdesks operations. According to our research, 95% human efforts can be saved by incorporating AI-based call analysis with traditional manual operation. This statistic can bear remarkable financial meaning to companies whose helpdesk is a crucial part of their business.