Project Design
When designing a project with ability to process audio signals or audio data we typically consider a subset of the following components:
Input:
Analog signal input to connect e.g. a microphone
Storage media, e.g. microSD card with audio files to read
Wi-Fi interface to obtain an audio data stream from the internet
Bluetooth interface to obtain an audio data stream from e.g. a Bluetooth headset
I2S interface to obtain audio data stream from a codec chip
Ethernet interface to obtain an audio data stream from the internet
An internal chip’s flash memory with some audio samples to play
User Interface e.g. buttons or some other means to provide user input
Output:
Analog signal output to connect headphones or speakers
Storage media, e.g. microSD card to write some audio files, e.g. with recording
Wi-Fi interface to send out an audio data stream to the internet
Bluetooth interface to stream audio data to e.g. a Bluetooth headset
I2S interface to stream some data to a codec chip
Ethernet interface to stream an audio data stream to the internet
An internal chip’s flash memory to store some audio recording
User Interface e.g. a display, LEDs or some means of haptic feedback
Main Processing Unit:
A microcontroller or a computer with processing power to read the data from the input, process (e.g. encode / encode) and send to the output.
Project Options
The ESP chips (including ESP32, ESP32-S2, ESP32-S3) have all the above features or are able to support them (e.g. can drive Ethernet PHY). Considering the ESP chip cost is low, and availability of ESP-ADF software development platform, we are able to develop an audio project with minimum additional components at very low price.
Depending on the application, required functionality and performance, we may consider two project groups.
Minimum - having minimum additional components, assuming using on board I2S, or PDM interface as well as DAC, if no high qualify audio on the output is required.
Typical - with an external codec chip and a power amplifier, for high quality output audio and multiple input / output options.
There may be several variation between the above projects, by adding or removing features/components. Below are a couple of examples.
Project Minimum
With several peripherals on an ESP chip, I2S or PDM or DAC interfaces can be used to implement a minimum project. With the digital microphones, we could input voice signals and build a command voice control project minimum that could communicate with a cloud service.
Audio Project Example - Send Voice Commands to Cloud Service
With two on board DACs, if 8-bit width on the output is satisfactory, we may implement another project minimum - a device to play an internet connected radio.
Audio Project Example - Internet Connected Radio Player
Typical Project
When looking for better audio quality and more interfacing options we would use an external I2S codec to do all the analog input and output signal processing. The codec chip, depending on type, may provide additional functionality like audio input signal preamplifier, headphone output amplifier, multiple analog input and outputs, sound effects, etc. The I2S is considered as the industry standard for interfacing with audio codec chips, or in general for a high speed, continuous transfer of the audio data. To optimize performance of audio data processing, an additional memory may be required. For such cases, please consider using ESP32-WROVER-E that provides 8 MB PSRAM on a single module together with the ESP32 chip.
Typical Audio Project Example
The ESP-ADF is designed primarily to support projects with a codec chip. The ESP32 LyraT board is an example of such a project. The software interfacing with the board is done by Audio HAL and a driver. The codec chip used on the ESP32 LyraT is ES8388. Boards with a different codec chip may be supported by providing a different driver.