SportSense
Recent estimates suggest that 70% of youth participate in sports, whereas fewer than 20% participate in out-of-school STEM experiences. SportSense imagines how unlocking new curiosities within athletes could transform the landscape of STEM learning, both in terms of who participates and types of innovations that emerge. In partnership with local organizations, we create learning environments where youth are introduced to ways that technology can help them improve their athletic performance, and ways that sports can improve their understanding of STEM concepts.
learn more BKP SportsBlinc
This team works on developing data-capture devices that provide educators with real-time multimodal learning analytics. We use ReSpeaker Core v2.0 microphone arrays to show educators what keywords have been said, a discussion timeline, direction of speech, and emotional tone indicators. We are also working to incorporate body pose estimation into our analyses. We have tested our devices in multiple classrooms and are continuing development and testing in the coming months.
learn moreLearning with Minecraft
Many in the media and the academia have touted Minecraft as a hotbed of learning. Learning with Minecraft studies how children might learn spatial reasoning and programming skills within and around the game. We are currently conducting a comparative study of student collaboration under two conditions: 1) Completing a construction task in a traditional Minecraft server; and 2) Using the MakeCode interface in Minecraft Education Edition. Additionally, we are using screen capture and eye tracking technologies to collect data and investigate spatial reasoning processes in Minecraft gameplay.
learn moreMulticraft + Tangicraft
Multicraft + Tangicraft works on multimodal interfaces to empower individuals with physical impairments to play and create in the popular video game Minecraft. Multicraft utilizes Gaze and Speech to replace the traditional mouse and keyboard interface. By looking at a location on the screen and uttering a command, users can build in the Minecraft world. Tangicraft utilizes tangible blocks with webcam detectable codes. Users can construct a physical structure in front of a webcam and call it in the Minecraft world by pressing a button on an Arduino microcontroller. Our team is currently conducting user tests to drive iteration on our initial designs.
learn moreMusicNU
MusicNU wis an interactive website that will take a chosen Spotify song from a user, transform it into a visual display, and analyze the song’s chord makeup, melody, rhythm, tempo, key, and other features to help students learn about music theory. Using Spotify’s Web API to generate song analysis, Melodia and Sonic Visualizer to extract a song’s melody, and AI/machine learning to identify chords, we will create a visual display of the song where users can learn about the music theory of the song in a fun, visual, and accessible way.
Global Aid Refugees (GAR)
Global Aid Refugees (GAR, pseudonym) works with tiilt to implement maker culture activities in after school and summer programming for refugee children ages 5-17 years old. Past activities include making games to creating tactile picture books using low and high tech fabrication tools and materials. This collaboration ran throughout the school year and during the summer.