This is an interactive game based on the setting of Harry Potter to learn some spells and get interesting results\feedback.
Fell in love with the Harry Potter series since young, I dream of having some kind of magic power on my own. And the different ml5 models we learned this semester could create similar outcomes as magic spells did. Therefore, I kept exploring the hand pose model and Postnet model to generate fancy programs based on the Hogwarts setting. My first step is to determine the model I need to utilize and to reduce video camera laggy, I finally decided only to use one hand pose model to trigger all the effects. Then, I watched the Harry Potter series again to arouse my memory of different spells, and I found some videos about magicians to find out the most appropriate hand poses to use. The next step is to define the different states and how different poses connect with magical effects. With the help of our TA Jung, I trained the hand pose model successfully and got four obvious outcomes with four different hand poses. The lesson I learned from this process is to prepare hand poses that have differences apparent enough to avoid ambiguity between various states. I also got help from our professor Daniel to get a cool particle effect, which helps me with two spells. Last but not least, I spent lots of time categorizing those states and adding sound effects, background images, instructions to the canvas. Though the final states are still not clear enough with inappropriate background appearing accidentally, I think I did show my concept 70%. The improvements I can focus on are the user testing part and thinking of adding physical installations. I can add the characters in the Harry Potter series to teach the users instead of just generating some texts about how to play those effects, or I can try to add a real feather floating as I do the floating hand pose. There will be more interesting effects and a better user experience as I explore more.
A Harry Potter game
The universal
Interaction design in the harry potter shop
ML models
Posenet
handpose
Inspired by the Harry potter game and the interesting interactive games to sell magic wands in Universal, I found that I can also get a interaction installation based on the knowledge I learned this semester. And I think the model I trained through posenet model or handpose model is even more interesting than the simple sensor in the harry potter shop.🤪
The audience are people like me who could get happiness through those magical effects.
The product may also be installed in the Harry Potter shop. In my opinion, these interactions are more fancy than touching different magic wands.