CISL Research


The Mandarin Project is at the forefront of advanced research in Cognitive and Immersive Classrooms for Cyber-Enabled Language Learning. It leverages speech-based dialogue for communication and information exchange in Mandarin between students and agents in an immersive environment, where students are engaged in task-oriented group activities with communications and other social practices.

This Situations Room Infrastructure (SRI) is the core of the technical innovations developed for cognitive and immersive rooms. This infrastructure enables multimodal group-computers dialog, learning and understanding of group activities, reasoning, planning and facilitation of collaborative decision-making. The first use case enabled by the SRI is in the area of mergers and acquisitions. The technologies from the project have laid the foundation for all other CISL use cases.

Multimodal narrative generation and presentation technologies enable the Situations Room to communicate discovery and insights from the cognitive computers to groups of people. The generated narratives both automatically thread the information from graph data store (e.g. DBpedia) into a meaningful and engaging story, as well as draw on creative computation to make analogies between information points which would otherwise remain buried in the data. Those narratives are then presented to the audience through the immersive situations room using text, pictures, visualizations and data sonification techniques.

Scientific exploration and discovery is the newest use case for the Situations Room Infrastructure. The room both learns from and works with experts to transform the decision-making process from an open-loop to a closed-loop with feedback from experts in the room.

Cyber-security intelligence analysis is a relatively new and compelling subject for a Situations Room use case. Research in this area is in early phases of planning and hypothesis generation.