Hi all,

I was checking out this video about an ‘AI-enabled speech pronunciation coaching app’ where it records your voice and gives feedback on your (English) pronunciation. With details on which part of the word needs more practice. Please watch a snippet of the video demonstrating it here.

Can someone recommend me papers/repositories explaining the algorithms and method that (most likely) enables the app to do exactly this?

My take on it will be using ASR (Automatic Speech Recognition) to do speech to phonemes and phonemes to a special grammar (e.g. ARPABET). Then the recognised speech, in the special grammar, is compared to the truth. If it matches, then your pronunciation is perfect. Otherwise, it will give you feedback on the specific part of the word that needs practice.

Thanks!