Do I have to listen to the audio each time?

The listen-and-repeat exercises with the audio material is essential to learn a language. You can master Japanese by listening to the audio to check Japanese pronunciation, practicing oral readings while looking at the text, and studying worksheets.