camera object classification blueprint

To use in Particle Workbench

1. In Workbench, select Particle: Import Project and select the project.properties file

2. Use Particle: Configure Project for Device and select the platform such as P2 and the latest 5.x or 6.x release.

3. Compile with Particle: Compile application (local)

4. Flash with Particle: Flash application (local)

At this time you cannot use the Particle: Cloud Compile or Particle: Cloud Flash options; local compilation is required.

Overview

This solution is designed for Particle devices like the Photon 2 and M-SoM.

Key Features

• Edge Impulse Integration: Uses Edge Impulse's machine learning capabilities to train a model to detect items in front of a camera.
• Seamless Deployment: Supports Particle devices such as the Photon 2, Boron, and M-SoM, enabling efficient edge processing.
• Versatile Applications: Suitable for applications such as smart home systems.

There is an excellent Edge Impulse Tutorial including a video for creating training data, selecting a model, training it, and deploying it.

Prerequisites

To complete this project, you will need:

1. Particle Device: Photon 2, Boron, or M-SoM.
   • Purchase here
2. Camera. This project uses a 4D systems uCAM-III
3. Edge Impulse Account: Sign up at Edge Impulse to train the model.

Table of Contents

• Overview
• Key Features
• Prerequisites
• Setup Steps
  • 1. Configure the Hardware
  • 2. Collect Training Data
  • 3. Train the Model on Edge Impulse
  • 4. Deploy the Model to Particle
  • 5. Test and Fine-Tune
• Conclusion

Setup Steps

1. Configure the Hardware

1. Connect 4D systems uCAM-III to your Particle device (Photon 2 or M-SoM). The colors don't matter but area shown here to make it easier to follow the picture.

Particle device	uCAM-III	Color
VUSB	5V	Green
RX	TX	Yellow
TX	RX	Orange
GND	GND	White
D2	RES	Gray

2. Set up your Particle device in the Particle Console to ensure it’s online and ready to transmit data.

To update this project

1. Collect Training Data

1. Log into Edge Impulse and create a new project for object detection.
2. Go to the Data Acquisition tab and collect sample data for the words you wish to detect. If you are generating your own audio sample data, you can generate samples using your phone, which is often easier than getting the raw samples off your Particle device.

2. Train the Model on Edge Impulse

1. In Edge Impulse, go to Create Impulse and select a suitable Signal Processing Block for camera data.
2. Add a Learning Block for classification.
3. Go to the Training tab, configure training parameters, and start training the model.
4. Monitor the training results to ensure high accuracy in distinguishing running water sounds.

3. Deploy the Model to Particle

1. Once the model is trained, go to the Deployment tab in Edge Impulse.
2. Export the model as a C++ library or a Particle-compatible model file.
3. Upload the model to your Particle device using the Particle CLI or Web IDE.
4. Configure the device firmware to run the model and classify data from the sensor.

4. Test and Fine-Tune

1. Deploy the Particle firmware and begin testing the device in real-world conditions.
2. Use the Edge Impulse Live Classification feature to validate model accuracy.
3. Fine-tune the model as needed by collecting additional data or adjusting training parameters.