spARk, 2018
spARk is an augmented reality STEM learning experience that encourages learning systems through hands-on explorations. This builds upon similar prior projects like Math Heroes, which uses mental models as a tool for understanding complex abstract phenomena.
Across a period of 3 months, spARk was part of the NYC Media Lab’s first XR Startup Bootcamp and developed through the Lean Startup method, interviewing and testing with 100 stakeholders in all: students, parents, teachers, educational researchers, investors. A sample lesson on photosynthesis was co-developed with a middle school biology teacher, and tested with several students in his class.
It was exhibited at NYVR Expo, presented at Exploring Future Reality 2018 event, and featured on EdSurge.
Created using Vuforia in Unity.
Research, Design, Augmented Reality Development
able., MFA Thesis Project, 2021
able. (Augmented Bench Learning Experiences) is a collection of physical and digital tools for remote novice electronics makers, using a mobile device.
Conceived during COVID-19 after interviews and research into maker communities, this project aims to address the challenges facing makerspaces and communities of practice. Using as many readily available and cost effective elements as possible, this project proposes ways to bridge challenges in remote guidance, self-guided learning, and accessibility.
Designing for a hands-free, mobile and web-centric workbench, able. consists of a toolkit of modular components that allow young makers to adapt to their home environment: multiple AR markers that display dynamic content and keep their state; dynamic AR displays that reflect the state of their prototyping board; a mirror attachment and a guided laser pointer that facilitates sharing and guidance on video calls.
Advisors: Katherine Moriwaki, Andrew Zornoza, Aya Karpinska, Louisa Campbell
Augmented reality Design & Development, Research
Math Heroes, 2017
Math Heroes is an augmented reality, hands-on learning experience that allows users to learn about algebra.
Using the model of the balance and based on educational research such as concrete-representational-abstract method, users place physical tiles on either end of the virtual plane to solve algebraic equations. It aims to encourage exploration into algebraic concepts such as negative numbers, while providing real-time or delayed feedback. It also allows for future extensions like game-based learning modes.
Math Heroes was part of Teachers College’s first Innovation Award. It was developed over the course of a semester through a Design Thinking framework, after interviews with students and educators, feedback from Teachers College advisors, and playtesting with peers.
It was one of four teams selected to present to the Teachers College Board of Trustees.
Developed using Unity and Vuforia.
Research, Augmented Reality Development
Circular Rhythm Machine, 2019
Circular Rhythm Machine is a rhythm synthesizer that uses tangible pieces captured by an RGB camera to make music. Designed to forefront visually polyrhythmic patterns, the static circular interface and sweeping hand designs were chosen for its periodic movement.
Circular Rhythm Machine was part of a thirteen-week studio project involving research, feedback and iteration. You can more about the design process on the project Github Page here, and the research paper here.
Created in Processing using its OpenCV library.
Advisor: Harpreet Sareen
Interaction Design, Development
pin(gpong)ball, 2020
pin(gpong)ball is a customizable projected pinball machine, with physical and digital parts.
Players can set up their own digital pinball machine with real physics, using real physical objects. In this current implementation, shaped plastic pieces are used as anchors for digital cartoon bumpers, but potentially players can also use their own objects to interact with the digital pinballs.
Developed in Openframeworks (C++), using ofxBox2d, ofArduino (StandardFirmata), ofxCV and ofKinect libraries.
Code and more info on Github, and my process log is here.
Advisors: Kyle Li, Michael Wolf