AI Language Learning - pronunciation training R&D

Our company is a startup focused on helping language learning students mastering a new language primarily via voice enabled applications. Currently we work with various OpenAI APIs and just released a language learning partner, voice based assistant you can try for yourself at https://sunnydays.tech/#talk-to-kaki   *Ideal candidates enjoy an open exploration challenge. Are learning or mastering 1 language in addition to their native language(s). Comfortable using Javascript|Typescript or Python.  We’re currently investigating a new feature, which you may lay down the groundwork for. The core of the feature is, given an audio file the student was just taught and are willing to repeat out loud, take a recording of their speech and compare against the original audio, while flagging any significant discrepancies where they happen. The logic may run on the FE or backend. We would like to collaborate with students to research and apply the latest artificial intelligence (AI) and machine learning (ML) techniques to our problem. Altho to be explicit it’s not necessary to apply said techniques if a classic crafted algorithm works well. The initial language to be considered may be one of: English, Japanese, Spanish, Portuguese. At any rate consider the solution must be able to adapt into multiple mainstream languages. Input: 2 audio files of the same encoding type (something common like .mp4), a base ideal vs. user recording. Output: an array of: either points in time, or ranges, where the pronunciation didn’t seem to match input.