ESP32-S3-EYE v2.2

This user guide will help you get started with ESP32-S3-EYE v2.2 and will also provide more in-depth information.

Note

If you use ESP32-S3-EYE v2.1, please follow this guide. The differences between v2.2 and v2.1 are described in Section Hardware Revision Details.

The ESP32-S3-EYE is a small-sized AI development board produced by Espressif. It is based on the ESP32-S3 SoC and ESP-WHO, Espressif’s AI development framework. It features a 2-Megapixel camera, an LCD display, and a microphone, which are used for image recognition and audio processing. ESP32-S3-EYE offers plenty of storage, with an 8 MB Octal PSRAM and a 8 MB flash. It also supports image transmission via Wi-Fi and debugging through a Micro-USB port. With ESP-WHO, you can develop a variety of AIoT applications, such as smart doorbell, surveillance systems, facial recognition time clock, etc.

ESP32-S3-EYE

ESP32-S3-EYE

The document consists of the following major sections:

1. Getting Started

1.1. Overview

The ESP32-S3-EYE board consists of two parts: the main board (ESP32-S3-EYE-MB) that integrates the ESP32-S3-WROOM-1 module, camera, SD card slot, digital microphone, USB port, and function buttons; and the sub board (ESP32-S3-EYE-SUB) that contains an LCD display. The main board and sub board are connected through pin headers.

1.2. Comparison with ESP-EYE

The ESP32-S3-EYE has some additional functions comparing to ESP-EYE, an ESP32-based development board. The comparison below covers key differences between the two boards:

Feature

ESP32-S3-EYE

ESP-EYE

Chip embedded

ESP32-S3

ESP32

PSRAM

8 MB Octal PSRAM

8 MB Quad PSRAM

Flash

8 MB flash

4 MB flash

LCD display

Yes

None

Accelerometer

Yes

None

Alternative power supply

External battery (optional)

None

USB-to-UART bridge

No need. Functionality is provided by ESP32-S3 USB Serial/JTAG interface.

Yes

Antenna connector

No need. Antenna is provided by the ESP32-S3-WROOM-1 module.

Yes

1.3. Block Diagram

The block diagram below presents main components of the ESP32-S3-EYE-MB main board (on the left) and the ESP32-S3-EYE-SUB sub board (on the right), as well as the interconnections between components.

ESP32-S3-EYE Block Diagram

ESP32-S3-EYE Block Diagram

The following sections will describe the key components on the main board and the sub board, respectively.

1.4. Components on the ESP32-S3-EYE-MB Main Board

ESP32-S3-EYE-MB - front and back

ESP32-S3-EYE-MB - front and back

The key components of the board are described from front view to back view, starting from the camera, in an anti-clockwise direction.

No.

Key Component

Description

1

Camera

The camera OV2640 with 2 million pixels has a 66.5° field of view and a maximum resolution of 1600x1200. You can change the resolution when developing applications.

2

Module Power LED

The LED (green) turns on when USB power is connected to the board. If it is not turned on, it indicates either the USB power is not supplied, or the 5 V to 3.3 V LDO is broken. Software can configure GPIO3 to set different LED statuses (turned on/off, flashing) for different statuses of the board. Note that GPIO3 must be set up in open-drain mode. Pulling GPIO3 up may burn the LED.

3

Pin Headers

Connect the female headers on the sub board.

4

5 V to 3.3 V LDO

Power regulator that converts a 5 V supply into a 3.3 V output for the module.

5

Digital Microphone

The digital I2S MEMS microphone features 61 dB SNR and –26 dBFS sensitivity, working at 3.3 V.

6

FPC Connector

Connects the main board and the sub board.

7

Function Button

There are six function buttons on the board. Users can configure any functions as needed except for the RST button.

8

ESP32-S3-WROOM-1

The ESP32-S3-WROOM-1 module embeds the ESP32-S3R8 chip variant that provides Wi-Fi and Bluetooth 5 (LE) connectivity, as well as dedicated vector instructions for accelerating neural network computing and signal processing. On top of the integrated 8 MB Octal SPI PSRAM offered by the SoC, the module also comes with 8 MB flash, allowing for fast data access. ESP32-S3-WROOM-1U module is also supported.

9

MicroSD Card Slot

Used for inserting a MicroSD card to expand memory capacity.

10

3.3 V to 1.5 V LDO

Power regulator that converts a 3.3 V supply into a 1.5 V output for the camera.

11

3.3 V to 2.8 V LDO

Power regulator that converts a 3.3 V supply into a 2.8 V output for the camera.

12

USB Port

A Micro-USB port used for 5 V power supply to the board, as well as for communication with the chip via GPIO19 and GPIO20.

13

Battery Soldering Points

Used for soldering a battery socket to connect an external Li-ion battery that can serve as an alternative power supply to the board. If you use an external battery, make sure it has built-in protection circuit and fuse. The recommended specifications of the battery: capacity > 1000 mAh, output voltage 3.7 V, input voltage 4.2 V – 5 V.

14

Battery Charger Chip

1 A linear Li-ion battery charger (ME4054BM5G-N) in ThinSOT package. The power source for charging is the USB Port.

15

Battery Red LED

When the USB power is connected to the board and a battery is not connected, the red LED blinks. If a battery is connected and being charged, the red LED turns on. When the battery is fully charged, it turns off.

16

Accelerometer

Three-axis accelerometer (QMA7981) for screen rotation, etc.

1.5. Components on the ESP32-S3-EYE-SUB Sub Board

ESP32-S3-EYE-SUB - front and back

ESP32-S3-EYE-SUB - front and back

The key components of the board are described from front view to back view, starting from the LCD display, in an anti-clockwise direction.

Key Component

Description

LCD Display

1.3” LCD display, connected to ESP32-S3 over the SPI bus.

Strapping Pins

Four strapping pins led out from the main board. They can be used as testing points.

Female Headers

Used for mounting onto the pin headers on the main board.

LCD FPC Connector

Connects the sub board and the LCD display.

LCD_RST

LCD_RST testing point. You can use it to reset the LCD display with control signals.

1.6. Contents and Packaging

1.6.1. Retail Orders

If you order a few samples, each board comes in an individual box. Each box contains:

  • 1 x ESP32-S3-EYE-MB main board

  • 1 x ESP32-S3-EYE-SUB sub board

The main board and sub board are assembled by default. For retail orders, please go to <https://www.espressif.com/en/company/contact/buy-a-sample>.

1.6.2. Wholesale Orders

If you order in bulk, the boards come in large cardboard boxes. For wholesale orders, please go to <https://www.espressif.com/en/contact-us/sales-questions>.

1.7. Default Firmware and Function Test

Each ESP32-S3-EYE board comes with pre-built default firmware that allows you to test its functions including voice wake-up, voice command recognition, face detection and recognition. To test the board’s functions, you need the following hardware:

  • 1 x ESP32-S3-EYE

  • 1 x USB 2.0 cable (Standard-A to Micro-B), for USB power supply

Before powering up your board, please make sure that it is in good condition with no obvious signs of damage. Both the main board and the sub board should be firmly connected together. Then, follow the instructions described below:

  1. Connect the board to a power supply through the USB Port using a USB cable. While the board is powered up, you will notice the following responses:

  • The Module Power LED turns on for a few seconds, indicating that the default firmware is being loaded.

  • The Module Power LED turns off, indicating the default firmware has been loaded. The board enters human face recognition mode by default.

  • The LCD display shows live video streaming.

At this point, the board is ready for further instructions. You can control the board with either function buttons or voice commands. Function button control is described first:

  1. Face the camera so whole human face is visible on the screen for the board to detect. Once a human face is detected, the board displays a blue rectangle.

  2. Press MENU so that the board enters an ID (starting from 1) for a detected human face.

  3. Press UP+ so that the board starts face recognition. Once a face is recognized, the board displays the entered face ID. If it doesn’t know the face, it displays “WHO?”.

  4. Press PLAY to delete the latest face ID. The board displays “XXX ID(S) LEFT”.

To control the board with voice commands, follow the instructions below:

  1. Complete step 1 described previously and notice responses from the board.

  2. Activate the board with the default English wake word “Hi ESP”. When the wake word is detected, the Module Power LED will turn on, indicating that the board is ready for a speech command.

  3. Say an English speech command to control the board. Once a speech command is recognized, the Module Power LED will blink. The supported English speech commands in face recognition mode are listed below:

Default English Speech Commands

Response

Enter face

The board enters a human face ID.

Recognize face

The board displays a recognized human face ID, or “WHO?” for an unrecognized face.

Delete face

The board deletes the latest human face ID entered and displays “XXX ID(S) LEFT”.

  1. After waking up the board as described in step 2, you can also switch the board’s working mode with speech commands. Once a speech command is recognized, the Module Power LED will blink.

Speech Commands for Different Working Modes

Response

Face recognition

The board displays a blue rectangle if a human face is detected.

Motion detection

The board displays a solid blue rectangle in upper-left corner if motion is detected.

Display only

The board displays only live video streaming.

Stop working

The board does nothing and displays Espressif logo.

Now you get the first experience with the board. The following sections provide further information about how to flash firmware onto the board, configuration options, related resources, and more.

2. Start Application Development

This section provides instructions on how to do hardware/software setup and flash firmware onto the board for application development.

2.1. Required Hardware

  • 1 x ESP32-S3-EYE

  • 1 x USB 2.0 cable (Standard-A to Micro-B), for USB power supply and flashing firmware on to the board

  • 1 x Computer running Windows, Linux, or macOS

2.2. Optional Hardware

Note

Be sure to use a Li-ion battery that has built-in protection circuit.

2.3. Hardware Setup

Prepare the board for loading of the first sample application: Connect the board with the computer through the USB Port using a USB cable. The Module Power LED should turn on. Assuming that a battery is not connected, the Battery Red LED will blink. Now the board is ready for software setup.

2.4. Software Setup

After hardware setup, you can proceed with preparation of development tools. Go to the guide to ESP-WHO, which will walk you through the following steps:

  1. Get ESP-IDF which provides a common framework to develop applications for ESP32-S3 in C language.

  2. Get ESP-WHO which is an image processing platform that runs on ESP-IDF.

  3. Run Examples that are provided by ESP-WHO.

3. Hardware Reference

This section provides more detailed information about the board’s hardware.

3.1. Notes on GPIO Allocations

Except for GPIO3 that can be used to configure LED statuses, all GPIOs of the ESP32-S3-WROOM-1 module have already been used to control specific components or functions of the board. If you would like to configure any pins yourself, please refer to the schematics provided in Section Related Documents.

3.2. Independent Module and Camera Power Supply

The ESP32-S3-EYE board features independent power supplies to the camera and the remaining components. This should reduce noise in the audio signal from module components and improve overall performance of the components.

ESP32-S3-EYE - Module Power Supply

ESP32-S3-EYE - Module Power Supply

ESP32-S3-EYE - Camera Power Supply

ESP32-S3-EYE - Camera Power Supply

4. Hardware Revision Details

4.1. Revision History

Compared to ESP32-S3-EYE v2.1, ESP32-S3-EYE v2.2 has two changes in hardware: 1) marking on the main board,2) additional current limiting resistor on the main board; and one change in firmware: additional support for English wake-up word and commands. Changes in hardware are described in detail below:

  1. Marking on the (back of) main board: ESP32-S3-EYE v2.2 has marking “ESP32-S3-EYE-MB_V2.2” on the main board, while ESP32-S3-EYE v2.1 has marking “ESP32-S3-EYE-MB_V2.1” on the main board.

ESP32-S3-EYE-MB_V2.2 Marking

ESP32-S3-EYE-MB_V2.1 Marking

ESP32-S3-EYE-MB_V2.2 Marking

ESP32-S3-EYE-MB_V2.1 Marking

  1. The current limiting resistor R83 is added to the ESP32-S3-EYE v2.2 main board to protect the Module Power LED from burning in case GPIO3 is pulled up.

ESP32-S3-EYE v2.2 with R83

ESP32-S3-EYE v2.1 Without R83

ESP32-S3-EYE v2.2 with R83

ESP32-S3-EYE v2.1 Without R83

  1. The main board schematics, main board PCB layout diagrams, main board dimension diagrams, main board dimension source files are updated because of the two hardware changes. (See Related Documents).

4.2. known Issues

ESP32-S3-EYE does not have a USB-to-UART bridge, which may cause a problem: If the program flashed onto the board keeps the chip rebooting, you cannot flash more programs onto the board. In case this issue occurs, you need to:

  • Hold down BOOT button and press RST button, then release RST button first, and BOOT button next. In this way, the board enters Firmware Download mode and you can start flashing program onto the board.

  • After flashing the program, press RST button to start the program.


Was this page helpful?