Screen Shot 2019-05-16 at 12.27.43 AM.png

GOAL

I am exploring how machining learning approaches can create tools to help children in their early developments. I am applying digital data on physical objects to create a sensory environment to provide a richer textural experience to construct a 3 dimensional world for children.

CULTURE

There are many existing tools that engage with children’s arbitrary association between visual and auditory novel stimuli when the visual stimuli are explored with both visual and haptic modalities. I wanted to create a dynamic educational tool for children through playful ways.

Saved in Wekinator through Arduino and Max/MSP, using Bare Conductive Paint and 3D printed objects.

INPUT

Human touch generates a toggle input to computer

Saved in Wekinator through Arduino and Max/MSP, using Bare Conductive Paint and 3D printed objects.

OUTPUT

Audio files

RULES

Screen Shot 2019-05-19 at 5.42.44 PM.png

Classification – K Nearest Neighbor algorithm. Using each input to generate a specific output. I created the rules.

When a user matches a puzzle piece correctly, it triggers an audio output when they are still touching the object. A sound can be generated while touching again after the puzzle is in place. It is aimed the users to explore different sounds that different animal puzzles generate.