I am exploring how machining learning approaches can create tools to help children in their early developments. I am applying digital data on physical objects to create a sensory environment to provide a richer textural experience to construct a 3 dimensional world for children.
There are many existing tools that engage with children’s arbitrary association between visual and auditory novel stimuli when the visual stimuli are explored with both visual and haptic modalities. I wanted to create a dynamic educational tool for children through playful ways.
Human touch generates a toggle input to computer
Saved in Wekinator through Arduino and Max/MSP, using Bare Conductive Paint and 3D printed objects.
Classification – K Nearest Neighbor algorithm. Using each input to generate a specific output. I created the rules.
When a user matches a puzzle piece correctly, it triggers an audio output when they are still touching the object. A sound can be generated while touching again after the puzzle is in place. It is aimed the users to explore different sounds that different animal puzzles generate.
Board Game / Puzzle
● Conductive Paint
● Wooden Panels
● 3D printing
Arduino – Capacity Sensor Library