Keyword detection ESP32 Workshop

7th June @ 17.00pm - 21.00pm

Never been easier to implement keyword detection algorithms. In this workshop we will do the full design loop from specification, implementation to field test of a simple keywork detection system using the IoT workhorse ESP32 and Edge Impulse studio.

Form: workshop

Date: 7th June 2022

Time: 17.00-21.00

Square: IDA, Kalvebod Brygge 31-33, Copenhagen V

Price: Please refer to registration page on IDA.dk for further information.

Language: English

If you have questions about signing up, please contact Murielle De Smedt, mds@danishsound.org

Participant profile:

  • DSP Engineers
  • Audio programmers
  • Researchers
  • Students
  • Anyone wishing to get started with machine learning
You will meet:

Program

 

Edge Impulse (Netherlands) has a good track record in making Machine Learning (ML) available and easy to implement on a long list of microprocessors platforms. They span from simple arms based Arduino to advances specialized ML processor like Nvidia's Jetson Nano and Greenwaves GAP7 / 8. 

Edge Impulse have just released official support for Espressif ESP32 and in this workshop we will implement a simple keyword detection algorithm on ESP32 a based development board. 

We will have Jenny Plunkett from Edge Impulse to introduce the tools and workflow and run the workshop. She will be joining us via a video link and we will have Jørgen Kragh Jakobsen to co-host onsite. 

 

Keyword detection

We all know that we can have attention from our smart speakers or phones by calling “Alexa” or “Hey Google”. In this work shop we will create our own list of keywords and create at Machine Learning algorithm that can detect words from this list in a real time audio stream. 

We will go through the full process:

1. Selected a worthy machine learning model

2. Design a signal processing pipeline

Train the model with labeled data

4. Apply the model on the ESP32 processor

5. Test the implementation

All steps will be handled using Edge Impulse Studio that links your USB connected device to a web based cloud solution that runs Google's Tensor flow and various data management tools to organize data and generate code that allow your model to run on your local device. 

 

Workshop

Bring a labtop with a working Linux distribution, native or as Linux for Windows subsystem. Additional you need a working ESP-IDF development system - If you do not have that already, we have created a github repo with a simple installation process.

https://github.com/IDA-Embedded/esp32-getting-stated

We will bring ESP32 modules with microphones for keywork recording / training and to test our implementation. The workshop is a physical rerun of the 5. April 2022 webinar held by Danish Sound Cluster and Edge Impulse https://danishsoundcluster.dk/edge-impulse-for-consumer-audio-applications/

There will be served sandwiches, soft drinks and the / coffee during the workshop and there will be plenty of room for networking.

Has worked 25 year as Chip designer in startup and big corp. Nokia, Ericsson, Oticon, Merus Audio and Infineon. Here he has done everything from Analog, digital, physical to system architecture, software and production test. Has worked on Espressif processors professionally and in various open source project. Jørgen has done ESP32 workshops with IDA Embedded over the last 4 years.

A Texas Longhorn and software engineer, working as a Senior Developer Relations at Edge Impulse. Since graduating from The University of Texas she has been working in the IoT space, from customer engineering and developer support for Arm Mbed to consulting engineering for the Pelion device management platform. 

Jenny Plunkett, Edge Impulse

Innovation
When you participate in this event, your time will be used as co-financing for the Innovation Power Project, which is funded by the Danish Business Promotion Board and the Danish Agency for Education and Research at a standard rate. Read more about Innovationskraft  HERE.

This event was created in collaboration with IDA Embedded. The participant list of this event will be shared with IDA for statistical use only. 

Stay up to date

Sign up for our newsletter: