Middleware level
Drivers
Applications
(food recognition, person presence detection, people counting,
USB webcam)
FatFS
(Light FAT file system)
Hardware abstraction layer
(HAL)
Board support package
(BSP)
Hardware components
STM32 LCDCamera sensor
Development boards
STM32H747I-DISCOB-CAMS-OMV
STM32_ImageProcessing_Library
(Feature-rich image processing library)
STM32_AI_Runtime
(Neural Network runtime library)
STM32_AI_Utilities
(Optimized routines)
STM32_USB
(Device library)
Product status link
FP-AI-VISION1
Artificial Intelligence (AI) and computer vision function pack for STM32Cube
FP-AI-VISION1
Data brief
DB3962 - Rev 6 - December 2021
For further information contact your local STMicroelectronics sales office.
www.st.com
Features
• Complete firmware to develop a computer vision application on an STM32 microcontroller
• Feature-rich image processing library (STM32_ImageProcessing_Library)
• Neural Network library optimized for STM32 (STM32_AI_Runtime) generated by means of the X-CUBE-AI Expansion
Package for STM32CubeMX
• Food recognition application based on Convolutional Neural Network
• Person presence detection application based on Convolutional Neural Network
• People counting application based on object detection Neural Network model
• USB webcam application enabling the STM32H747I-DISCO board to act as a USB video camera (UVC) device when
connected to a host
• Integration examples based on float and quantized models
• Libraries enabling the test, debug, and validation of the embedded application
• Support for camera frame capture to enable image dataset collection
• Sample implementations available for the STM32H747I-DISCO Discovery board connected to the B-CAMS-OMV camera
module bundle
• Free and user-friendly license terms
Description
FP-AI-VISION1 is an STM32Cube function pack featuring examples of computer vision applications based on a Convolutional
Neural Network (CNN).
FP-AI-VISION1 is composed of software components generated by the X-CUBE-AI Expansion Package complemented with
application software components dedicated to the AI-based computer vision application.
The application examples provided in the function pack are food recognition (recognizing among 18 classes of common food),
person presence detection (identifying whether a person is present in the image or not), and people counting (counting the
number of persons in a scene) based on an object detection Neural Network model.
FP-AI-VISION1 implements an advanced computer vision application using STM32_AI_Runtime Neural Networks libraries.
Libraries are based on pretrained models and are generated with the X-CUBE-AI Expansion Package for the STM32CubeMX
tool.
The function pack demonstrates the integration of two types of Neural Network model: 32-bit floating-point model and 8-bit
quantized model. It also demonstrates model integration in different memory configurations (relying only on MCU internal
memory or using also external memories).
The FP-AI-VISION1 function pack includes a feature-rich image processing library, STM32_ImageProcessing_Library, that
enables both the common processing tasks (such as image rescaling and pixel color conversion) and advanced processing
tasks (such as face detection). The STM32_ImageProcessing_Library also provides a set of utility functions to read and write
several file formats.
The FP-AI-VISION1 function pack also includes the drivers for the camera as well as the framework for capturing images into
the frame buffer, preprocessing the content of the frame buffer, and running the Neural Network inference.
The FP-AI-VISION1 function pack features a USB webcam application, which can be used to create image and video datasets
as well as to perform live testing on the host. The FP-AI-VISION1 runs on the STM32H747I-DISCO Discovery board connected
to the B-CAMS-OMV camera module bundle (advised) or STM32F4DIS-CAM camera daughterboard (legacy only).
FP-AI-VISION1
DB3962 - Rev 6
page 2/6
