Technological Innovations for Inclusive Learning & Teaching (tiilt) lab at Northwestern University aims to improve learning opportunities for students from under-served communities.
2018

Worsley, M. & Blikstein, P. (under review). A Multimodal Analysis of Making. International Journal of Artificial Intelligence in Education.

Worsley, M., (in progress). Bridging Engineering Education and Conceptual Change: An Analysis of Changes in Students' Perceptions of Structural Stability during Hands-on, Collaborative Learning Tasks.

Worsley, M. & Blikstein, P. (under review). A Multimodal Analysis of Making. International Journal of Artificial Intelligence in Education.

Worsley, M., (in progress). Bridging Engineering Education and Conceptual Change: An Analysis of Changes in Students' Perceptions of Structural Stability during Hands-on, Collaborative Learning Tasks.

Worsley, M. & Blikstein, P. (under review). A Multimodal Analysis of Making. International Journal of Artificial Intelligence in Education.

Worsley, M., (in progress). Bridging Engineering Education and Conceptual Change: An Analysis of Changes in Students' Perceptions of Structural Stability during Hands-on, Collaborative Learning Tasks.

2017

Andrade, A., & Worsley, M. (2017). A methodological framework for the exploratory analysis of multimodal features in learning activities. CEUR Workshop Proceedings, 1828, 99-103.

Worsley, M. (2017). Engineering design with everyday materials multimodal dataset. CEUR Workshop Proceedings, 1828, 104-110.

Worsley, M. & Blikstein, P. (2017). Reasoning Strategies in the Context of Engineering Design with Everyday Materials. The Journal of Pre-College Engineering Education Research, 6(2), 57-74.

2016

Ochoa, X. & Worsley, M. (2016). Augmenting Learning Analytics with Multimodal Sensory Data. Journal of Learning Analytics, 3(2), 213–219.

READ PDF

Blikstein, P. & Worsley, M. (2016). Multimodal Learning Analytics and Education Data Mining: using computational technologies to measure complex learning tasks. Journal of Learning Analytics, 3(2), 220-238. http://dx.doi.org/10.18608/jla.2016.32.11

PDF

Worsley, M., Abrahamson, D., Blikstein, P., Grover, S., Schneider, B., & Tissenbaum, M. (2016). Situating multimodal learning analytics. In C.-K. Looi, J. L. Polman, U. Cress, & P. Reimann (Eds.), "Transforming learning, empowering learners," Proceedings of the International Conference of the Learning Sciences (ICLS 2016) (Vol. 2, pp. 1346-1349). Singapore: International Society of the Learning Sciences.

PDF
2015

Worsley, M. Scherer, S., Morency, L.P., & Blikstein, P. (2015). Exploring Behavior Representation for Learning Analytics. In Proceedings of the 2015 International Conference on Multimodal Interaction. ACM, New York, USA. pp. 251-258.

PDF

Worsley, M, Chiluiza, K., Grafsgaard, J., & Ochoa, X.,. (2015). 2015 Multimodal Learning and Analytics Grand Challenge. In Proceedings of the 2015 International Conference on Multimodal Interaction. ACM, New York, USA. pp. 525-529.

READ

Worsley, M. & Blikstein, P. (2015). Using Learning Analytics to Study Cognitive Disequilibrium in a Complex Learning Environments. In Proceedings of the 5th Annual Conference on Learning Analytics and Knowledge, ACM, New York, USA. pp. 426-247.

READ
2014

Ochoa, X., Worsley, M., Chiluiza, K., & Luz, S. (2014). MLA'14: Third Multimodal Learning Analytics Workshop and Grand Challenges. In Proceedings of the 16th International Conference on Multimodal Interaction (ICMI '14). ACM, New York, NY, USA. pp. 531-532.

READ

Worsley, M. (2014). Multimodal Learning Analytics as a Tool for Bridging Learning Theory and Complex Learning Behaviors. In Proceedings of the 2014 ACM workshop on Multimodal Learning Analytics Workshop and Grand Challenge (MLA '14). ACM, New York, NY, USA. pp. 1-4.

PDF

Worsley, M. & Blikstein, P. (2014). Deciphering the Practices and Affordances of Different Reasoning Strategies through Multimodal Learning Analytics. In Proceedings of the 2014 ACM workshop on Multimodal Learning Analytics Workshop and Grand Challenge (MLA '14). ACM, New York, NY, USA. pp. 21-27.

PDF

Blikstein, P., Worsley, M., Piech, C., Gibbons, A., Sahami, M., & Cooper, S. (2014). Programming Pluralism: Using Learning Analytics to Detect Patterns in Novices' Learning of Computer Programming. International Journal of the Learning Sciences. Vol. 23, Iss. 4. pp. 561-599.

PDF

Worsley, M. & Blikstein, P. (2014). The Impact of Principle-Based Reasoning on Hands-on, Project-Based Learning. In Proceedings of the 2014 International Conference of the Learning Sciences. Vol 3. pp 1147-1151.

PDF

Worsley, M. & Blikstein, P. (2014). Using Multimodal Learning Analytics to Study Learning Mechanisms. In Proceedings of the 2014 Educational Data Mining Conference. pp. pp 431-432.

PDF

Worsley, M. & Blikstein, P. (2014). Making Smarter not Harder: Using Principle-based Reasoning to Promote Object Closeness and Improve Making. In Proceedings of the 2014 FabLearn Conference.

PDF

Worsley, M. & Blikstein, P. (2014). Analyzing Engineering Design through the Lens of Computation. Journal of Learning Analytics.

PDF
2013

Morency, L. Oviatt, S., Scherer, S. Weibel, N. & Worsley, M. (2013). ICMI 2013 Grand Challenge Workshop on Multimodal Learning Analytics. In Proceedings of the 15th ACM international conference on Multimodal interaction (ICMI '13). ACM, New York, NY, USA.

PDF

Worsley, M., &; Blikstein, P. (2013). Programming Pathways: A Technique for Analyzing Novice Programmers' Learning Trajectories. In Artificial Intelligence in Education. Springer Berlin Heidelberg. 844-847.

PDF

Gomes, J. Yassine, M., Worsley, M., & Blikstein, P. (2013) Analysing Engineering Expertise of High School Students Using Eye Tracking and Multimodal Learning Analytics. In Proceedings of the Educational Data Mining 2013 (EDM '13). Memphis, TN, USA. 375-377.

PDF

Worsley, M. & Blikstein, P. (2013). Toward the Development of Mulitmodal Action Based Assessment. In Proceedings of the Third International Conference on Learning Analytics and Knowledge (LAK '13). ACM, New York, NY, USA, 94-101.

PDF
2012

Worsley, M. (2012). Multimodal Learning Analytics: Enabling the Future of Learning through Multimodal Data Analysis and Interfaces. In Proceedings of the 14th ACM international conference on Multimodal interaction (ICMI '12). ACM, New York, NY, USA. 353-356. Doctoral Consortium Best Paper Runner-up.

PDF

Scherer,S., Worsley,M. & Morency, L. (2012). 1st international workshop on multimodal learning analytics: extended abstract. In Proceedings of the 14th ACM international conference on Multimodal interaction (ICMI '12). ACM, New York, NY, USA, 609-610.

PDF

Worsley, M. & Blikstein, P. (2012). An Eye For Detail: Techniques For Using Eye Tracker Data to Explore Learning in Computer-Mediated Environments. In the Proceedings of the 2012 International Conference of the Learning Sciences (ICLS '12). Sydney, Australia. 561-562.

PDF
2011

Worsley, M., Johnston, M. & Blikstein P. (2011). OpenGesture: a low cost authoring framework for gesture and speech based application development and learning analytics. In Proceedings of the 10th International Conference on Interaction Design and Children (IDC '11). ACM, New York, NY, USA. 254-256.

PDF

Worsley, M. & Blikstein P. (2011). What's an Expert? Using learning analytics to identify emergent markers of expertise through automated speech, sentiment and sketch analysis. In Proceedings for the 4th Annual Conference on Educational Data Mining. Eindhoven, Netherlands. 235-240.

PDF
2010

Worsley, M. & Johnston, M. (2010). Multimodal Interactive Spaces: MagicTV and MagicMAP. Spoken Language Technology Workshop (SLT '10), IEEE. San Francisco, CA, USA. 161-162.

PDF
Contact
Twitter
Marcelo Worsley — Director
...

I am an assistant professor of Learning Sciences and Computer Science at Northwestern's School of Education and Social Policy and the McCormick School of Engineering. The goal of my research is to advance society's understanding of how students learn in complex learning environments by forging new opportunities for using multimodal technology.

Kira Furuichi — Student
...

Kira is a junior in McCormick studying computer science with a minor in sociology. Her primary interest is in analyzing team dynamics and group work through looking at physiological responses. On her free time, you can find her running around Evanston, TA'ing EECS 330, or baking!

Simeon — Student

student, fourth year.

Bobbie Burgess — Student
...

Hiya! I am originally from the San Francisco Bay Area (Burlingame to be precise) and now I am at Northwestern as an undergraduate student (senior- winter '19) studying Manufacturing and Design Engineering. I am passionate about STEM education in MakerSpaces and how maker environments and curriculums can be crafted to empower students and teachers alike to be creative and make!

Eric Mertz — Student

Eric is graduating from Northwestern in June 2018 with a double major in Computer Science and Theatre. He mainly works on the Sony project and sometimes collaborates with David on the technology used in the lab at MetaMedia. He enjoys building tools that enable the users to achieve more.

Tim — Student
...

Tim is a junior majoring in Computer Science in the McCormick School of Engineering. He works as a research assistant at the lab. He is from Kenya and is passionate about how technology can be utilized to hasten development of third world countries.

Deniz Sagnaklar — Student

I’m a senior from Istanbul, Turkey studying Computer Science in the McCormick School of Engineering. During my time at Northwestern, I have been a member of Women in Computing and I have had the honor of founding BuildHer, Chicago's first ever student-run women's hackathon hosted here on campus, alongside six other women from NU. My interests outside of academics include basketball, surfing and painting.

Kya Suzuki — Student
...

I am a junior studying Computer Science in Weinberg, the school of Arts and Sciences. I am interested in the interdivality between language, narratives, music, and technology through the lens of education and coding.

Connor Bain — Student
...

Connor is a Ph.D. student in Computer Science and Learning Sciences originally from Columbia, SC. He's a proud University of South Carolina alumnus who studies how to help teachers integrate computation into their classrooms and how to get students to think with computation.

Khalil Anderson — Student
...

Born in Bronxville, New York and raised in Ellicott City, Maryland, Khalil, a UMBC Alum, is a Computer Science PhD student with interests in Machine Learning. More specifically with interests in Reinforcement Learning, NLP, and how Machine Learning can help augment, not necesarily replace, humans in task and jobs such as driving, learning, manufacturing, and any other area.

Sarah Lee — Student
...

Interested in the spaces around: making, memory, memorials, and museums, meaningful learning and engagement, empowerment, agentic memory identities and citizenship.

David Barel — Student
...

Originally from Tel-Aviv, Israel and currently working on my PhD in Learning Sciences at Northwestern's School of Education and Social Policy. I am interested in out of school learning and particularly how children learn around popular culture and media.

Kit Martin — Student

As such, I’ve become interested in multi-modal sensors. I see them as a bridge between agent based methods and my other evaluations frameworks.

Gabe Rojas-Westall — Student
...

I’m a junior studying Computer Science. I’m very interested in language (Spanish, Portuguese, and French are my favs), music, soccer, and building things! I’m involved with the Society of Hispanic Professional Engineers, NU World Cup, multicultural Greek life, and I’m also a TA for a few CS classes.

Durell Gill — Student
...

I am a junior studying computer science in Weinberg who mostly interested in learning sciences, web development, and devices within the Internet of Things space. I'm also a huge fan of Brazilian Jiu Jitsu and Muay Thai.

Emily Q. Wang — Student
...

Emily is a PhD student in the Technology and Social Behavior program. Her research in human-computer interaction focuses on creating accessible groupware systems for Deaf and hearing professionals. Before coming to Northwestern, Emily completed a self-designed engineering major with coursework in computer science, human-centered design, and psychology at Olin College of Engineering.

Shankar Salwan — Student

I am a Sophomore studying Computer Science, interested in the fields of Machine Learning and AI. Avid fan of soccer and will always dive into a conversation on "love, life and politics."

Melissa Perez — Student
...

I'm a Junior studying Computer Science, with minors in Latino Studies and Sociology. I'm involved in the Society of Hispanic Professional Engineers and Women in Computing, as well as am a Peer Mentor for a few intro CS classes. My favorite past times are going to Chicago and eating with friends.

Tom Large — Student

I am a student at Northwestern University studying computer science and math. Aside from my work at school and in the TIILT lab, I enjoy traveling, rock climbing, and some good music. I also love Cheez-Its.

Simeon — Student

student, fourth year.

Bobbie Burgess — Student
...

Hiya! I am originally from the San Francisco Bay Area (Burlingame to be precise) and now I am at Northwestern as an undergraduate student (senior- winter '19) studying Manufacturing and Design Engineering. I am passionate about STEM education in MakerSpaces and how maker environments and curriculums can be crafted to empower students and teachers alike to be creative and make!

Eric Mertz — Student

Eric is graduating from Northwestern in June 2018 with a double major in Computer Science and Theatre. He mainly works on the Sony project and sometimes collaborates with David on the technology used in the lab at MetaMedia. He enjoys building tools that enable the users to achieve more.

Tim — Student
...

Tim is a junior majoring in Computer Science in the McCormick School of Engineering. He works as a research assistant at the lab. He is from Kenya and is passionate about how technology can be utilized to hasten development of third world countries.

Gabe Rojas-Westall — Student
...

I’m a junior studying Computer Science. I’m very interested in language (Spanish, Portuguese, and French are my favs), music, soccer, and building things! I’m involved with the Society of Hispanic Professional Engineers, NU World Cup, multicultural Greek life, and I’m also a TA for a few CS classes.

Durell Gill — Student
...

I am a junior studying computer science in Weinberg who mostly interested in learning sciences, web development, and devices within the Internet of Things space. I'm also a huge fan of Brazilian Jiu Jitsu and Muay Thai.

Kit Martin — Student

As such, I’ve become interested in multi-modal sensors. I see them as a bridge between agent based methods and my other evaluations frameworks.

Inclusive Making

Excitement for the Maker Movement continues to grow. Part of this growth stems from the idea that Making provides a means for democratization of fabrication and invention. While this is true, in part, the practices and people that are typically included under this brand are limited. In particular, issues of diversity, equity and inclusivity are seldom at the forefront of the design and implementation of Makerspaces, the tools used or the artifacts created. Hence, the purpose of this course is to bring issues of diversity, equity and inclusivity to the forefront. In particular, the course will push students to:

  1. critically explore Making as a practice that promotes democratization.
  2. develop interfaces that allow a broader population of students to participate in digital fabrication.
  3. co-design artifacts that positively impact accessibility and inclusivity.
The course will include guest speakers, laboratory portions and a final project that encourages students to develop publishable scholarship and/or functional prototypes, as they work in interdisciplinary teams.
Interactive Media and Technology for Learning

This is a hands-on projectcourse. All students will design and implement interactive technologies for supporting learning. Students will be expected to do computer programming as part of this class. During this course, students will get a hands-on introduction to designing novel interfaces with multimodal sensor technology. Each week students will explore a specific modality or theory, and complete one or more activities that will challenge them to utilize that theory or modality. In order to support a strong introduction to both theory and practice, every week will include one class session involving hands-on work, and another that uses a seminar style to discuss theory and closely examine the assigned Readings. Students will be expected to use insights and ideas presented in the class in a collaborative final project.

  • FALL 2018
  • EECS 395
  • LS 307
Designing Technology with New Media

During this course students will complete a series of technology design activities that range from using speech and gesture technologies, to designing a toy for a kid. Students will be challenged to apply their knowledge of the learning sciences to real-world applications as they learn about different forms of new media that enable learners to experience and engage learning in new ways.

  • Spring 2017
IMR (Imagine, Make, Repeat)
...

IMR (Imagine, Make, Repeat) works with educators to plan and implement Makerspace technologies and projects in classrooms and Makerspaces throughout Evanston and Chicago. IMR has appeared at STEMFest, YEA! festival, and has collaborated with Chute Middle School, MetaMedia at the Evanston YMCA, and the Evanston Public Library. Going forward, the IMR team looks to further develop and expand partnerships with educators and making communities across the Chicagoland area.

  • Team
  • Sarah
  • Bobbie
  • Melissa
Tangicraft

Tangicraft is an interface to enable visually impaired individuals to play Minecraft. Our design includes two main components, a wearable device that allows players to haptically sense what is on the screen, and a set of tangible blocks which allow players to physically construct objects and place them in the game world using speech commands and computer vision.

  • Team
  • Shanks
  • David Barel
  • Tom Large
  • Tim
  • Yasmeen Wood
HHHHHHHH

NOTHING TO SEE HERE ... YET