People counting embedded in a camera
People detection and counting on high-performance MCU.
Making buildings and offices smarter means placing people at the heart of the environments we live and work in. This paradigm shift requires a particular attention by our surrounding electronics on the sensing intelligence. In this context, the people counting functionality becomes of paramount importance to adjust in real-time heater, HVAC or occupancy management. It results in more comfort for occupants and higher energy management efficiency.
Approach
- This prototype can count in real-time and with a high level of accuracy the restaurant's attendance.
- This is achieved thanks to the artificial intelligence algorithm embedded on the STM32 microcontroller and the use of a thermal infrared technology.
- We've used the FP-AI-VISION1 function pack code example running on an STM32H747I-D + B-CAMS-OMV board.
Sensor
Data
Data format
Single class: people
RGB color images
Single class: people
RGB color images
Results
Model: YOLO Low Complexity quantized neural network
Input size: 240x240x3
Memory footprint:
277 KB Flash for weights
233 KBRAM for activations
Accuracy: 55.88% Average Precision using a 50% IoU against the PASCAL VOC test dataset
Performance on STM32H747* (High-perf) @ 400 MHz
Inference time: 371 ms
Frame rate: 2.7 fps
* As measured with STM32CubeAI 7.1.0 in FP-AI-VISION1 3.1.0
Input size: 240x240x3
Memory footprint:
277 KB Flash for weights
233 KBRAM for activations
Accuracy: 55.88% Average Precision using a 50% IoU against the PASCAL VOC test dataset
Performance on STM32H747* (High-perf) @ 400 MHz
Inference time: 371 ms
Frame rate: 2.7 fps
* As measured with STM32CubeAI 7.1.0 in FP-AI-VISION1 3.1.0
Resources
Optimized with STM32Cube.AI
A free STM32Cube expansion package, X-CUBE-AI allows developers to convert pretrained AI algorithms automatically, such as neural network and machine learning models, into optimized C code for STM32.
Compatible with STM32H7 series
The STM32 family of 32-bit microcontrollers based on the Arm Cortex®-M processor is designed to offer new degrees of freedom to MCU users. It offers products combining very high performance, real-time capabilities, digital signal processing, low-power / low-voltage operation, and connectivity, while maintaining full integration and ease of development.
