Machine Learning / UI & UX / Agriculture
How Might We help the food industry detect harmful foods?
Do you remember when your grandma knocked on watermelons to see if they were ripe? The subtle art of picking out fresh produce is a dying art.
Exploring sound diagnostics through everyday experience, Knock Knock is a mobile application concept that uses machine learning algorithms to discover the ripeness of fruits.
Interdisciplinary team of designers & engineers. Hanson Cheng, Bahareh Saboktakin Rizi, Fay Feng, and Hugo Richardson.
Image & Sound Data
Using image and sound data we would be able to determine the ripeness of a fruit.
Fruits are classified by color, shape and size. We created an initial data set of labeled image data to then train the sound machine learning algorithm. We validated our idea by training a convolutional neural network model for real time object detection using Tensorflow.
We gathered a library of audio files from knocking on objects.
Using the API The Fast Fourier Transform (FFT) converts knocks of the collected audio files from time to the frequency domain.
This shows a promising pattern that could be used for further classification.