D'Mello's research is at the intersection of the cognitive, affective, computing, and learning sciences. His team is interested in the dynamic interplay between cognition and emotion while individuals and groups engage in complex real-world tasks. The team applies insights gleaned from this basic research program to develop intelligent technologies that help people achieve to their fullest potential by coordinating what they think and feel with what they know and do. 

This research uses a range of techniques such as eye tracking, speech and language processing, physiological sensing, computer vision, time series analyses, discourse modeling, and machine learning. The interaction contexts include educational games, collaborative problem solving, classroom discourse, computerized reading, and workplace activities. Data is collected in the lab, online, in schools, and the workplace.

Using learning engineering methods, the project aims to rapidly transform tutoring from a one-on-one, human or technical solution to a multimodal, multi-party, human and computer synergy, reaching over 275,000 diverse, low-income students within 5 years. We are excited to partner with Saga Education, a large non-profit provider of tutoring services to Title 1 schools.

We aim to bring together the best of what human tutoring and AI have to offer. Drawing on the profound benefits of a human tutor our HAT platform recommends challenging tasks, facilitates rich discussions, fosters relationships among students and tutors, provides feedback and guidance, and promotes collaborative learning.