It has never been easier to implement keyword detection algorithms. In this workshop we will do the full design loop from specification, implementation to field test of a simple keywork detection system using the IoT workhorse ESP32 and Edge Impulse studio.
Form: workshop
Date: 7 June 2022
Time: 17.00 – 21.00
Place: IDA, Kalvebod Brygge 31-33, København V
Price: Please refer to registration page on IDA.dk for further information.
Language: English
If you have questions about signing up, please contact Murielle De Smedt, mds@danishsound.org
Participant profile:
Edge Impulse (Netherlands) has a good track record in making Machine Learning (ML) available and easy to implement on a long list of microprocessors platforms. They span from simple arms based Arduino to advances specialized ML processor like Nvidia’s Jetson Nano and Greenwaves GAP7/8.
Edge Impulse have just released official support for Espressif ESP32 and in this workshop we will implementing a simple keyword detection algorithm on ESP32 a based development board.
We will have Jenny Plunkett from Edge Impulse to introduce the tools and workflow and run the workshop. She will be joining us via a video link and we will have Jørgen Kragh Jakobsen to co-host onsite.
Keyword detection
We all know that we can have attention from our smart speakers or phones by calling “Alexa” or “Hey Google”. In this work shop we will create our own list of keywords and create at Machine Learning algorithm that can detect words from this list in a real time audio stream.
We will go through the full process:
1. Selected a worthy machine learning model
2. Design a signal processing pipeline
3. Train the model with labeled data
4. Apply the model on the ESP32 processor
5. Test the implementation
All steps will be handled using Edge Impulse Studio that link your USB connected device to a web based cloud solution that runs Googles Tensor flow and various data management tools to organize data and generate codes that allow your model to run on your local device.
Workshop
Bring a laptop with a working Linux distribution, native or as Linux for Windows subsystem. Additional you need a working ESP-IDF development system – If you do not have that already, we have created a github repo with a simple installation process.
https://github.com/IDA-Embedded/esp32-getting-stated
We will bring ESP32 modules with microphones for keywork recording/training and to test our implementation. The workshop is a physical rerun of the 5. April 2022 webinar held by Danish Sound Cluster and Edge Impulse.
There will be served sandwich, soft drinks and the/coffee during the workshop and there will be plenty of room for networking.
Jørgen worked 25 year as Chip designer in startup and big corp. Nokia, Ericsson, Oticon, Merus Audio and Infineon. Here he has done everything from Analog, digital, physical to system architecture, software and production test. Has worked on Espressif processors professionally and in various open source projects. Jørgen has held ESP32 workshops with IDA Embedded over the last 4 years.
Jørgen Kragh Jakobsen – IC Works
A Texas Longhorn and software engineer, working as a Senior Developer Relations at Edge Impulse. Since graduating from The University of Texas she has been working in the IoT space, from customer engineering and developer support for Arm Mbed to consulting engineering for the Pelion device management platform.
Jenny Plunkett, Edge Impulse
Innovationskraft
When you participate in this event, your time will be used as co-financing for the Innovation Power Project, which is funded by the Danish Business Promotion Board and the Danish Agency for Education and Research at a standard rate. Read more about Innovationskraft HERE.
This event was created in collaboration with IDA Embedded. The participant list of this event will be shared with IDA for statistical use only.
