Index Ai Academy
Glossary · Phase 5 · Transformers

Fourier transform

The calculation that takes a stretch of samples and returns how much of each frequency it contains.

To find the frequencies in a stretch of samples there is a standard tool, the Fourier transform (np.fft.rfft). It takes a list of samples and returns how much of each frequency they contain: a spectrum.

Try it now

Press Next. The shapes are the ones the worked example at the end of part 2 prints.

Learn it properly

Sound as numbers: waveforms and spectrograms · A recording as an array of samples, why the sampling rate must be twice the highest pitch, spectrograms and the window trade-off, and the log-mel features a speech model is given. About 40 minutes.

Other terms from the same lesson

  • aliasing: A tone above half the sampling rate being recorded as a lower tone that was never there.
  • decibel: A unit for loudness on a log scale: halving the amplitude takes off 6, and dividing it by ten takes off 20.
  • log-mel spectrogram: The energy of a sound in a few dozen mel bands, every 10 ms or so, on a log scale. The usual input to a speech recognizer.
  • mel scale: A scale of pitch that follows hearing: fine at low frequencies and coarse at high ones.
  • Nyquist frequency: Half the sampling rate: the highest frequency a recording can hold correctly.
  • sampling rate: How many times a second a sound is measured, in hertz. Speech models usually use 16,000.
  • vocoder: The part of a speech synthesizer that turns a spectrogram into a waveform, filling in the detail a spectrogram doesn't hold.
Keep learning

More in plain English.

1286 terms in the glossary, each with the lesson that teaches it.

1286 terms

The glossary

Every word you'll meet in AI and machine learning, explained in everyday language.

Phase 5 · lesson 40 min

Sound as numbers: waveforms and spectrograms

A recording as an array of samples, why the sampling rate must be twice the highest pitch, spectrograms and the window trade-off, and the log-mel features a speech model is given.

Never trained an AI? Teach a small one to write, right in your browser. It takes about 20 seconds and needs no account. Teach it to write