Hui Su

Founding Director, CISL
Cognitive and Immersive Systems Lab

Hui Su is an executive and technical leader in IBM Research. He was the director of IBM Research Lab in Cambridge, MA., responsible for a broad scope of global missions in IBM Research, including Cognitive User Experience, Center for Innovation in Visual Analytics and Center for Social Business. 

As a technical leader and a researcher for 21 years in IBM Research, Hui Su has been an expert in multiple areas ranging from Human Computer Interaction, Cloud Computing, Visual Analytics, Neural Network Algorithms for Image Recognition etc. Hui has dozens of patents and technologies developed in these areas.

  • Hui led Software-as-a-Service research and Business Service Cloud in IBM China Research Lab and Watson Research Center from 2005 to 2012. The new technologies of this research work have become the business services offered by municipalities and business, and software-as-a-service platforms offered by major telecom providers.
  • Hui is always passionate about the interaction between human beings and intelligent computers as well as big data. His earlier results in Human Computer Interaction have enabled a broad range of IBM products, including input methods for IBM WorkPads, handwriting recognition for IBM TransNote, multimodal interaction middleware for Pervasive Computing offerings etc. The most recent work in Cambridge Lab in the area of Visual Analytics enables users to interactively explore complex data set and discover business insights. He also led the team develop the Cognitive Experience Lab in Cambridge to enable the multi-screen & multi-channel visualization, as well as the meeting room of the future.
  • Hui has also developed curriculums for service engineering and visual analytics and taught in Peking University and University of Connecticut. 

As an executive, Hui is always passionate about growing the game-changing ideas, speeding up the impact generation process for technical innovations, discover and develop new linkages between innovative research work and business needs. This includes:

  • Establishing In-Market Research(IMR) approach to bring research work closer to business needs and impact.  Hui led IMR in establishing a global social business innovation program in the context of Center for Social Business, for research team to provide social business transformation consulting to more than 7 large enterprises and generated huge business impact. Hui also led a few major IMR projects in Cloud Computing research with Government and Telecom clients in US and China to establish business services and cloud platform for them. These platforms are in operation today.
  • Developing and maintaining good relationship with clients and academic institutes. The clients include those from various industries ranging from banking, healthcare, governments and telecom etc. Hui also established collaborative projects with academic institutes e.g. MIT, University of Connecticut, Peking Universities, Tsinghua Universities etc. Hui also led the development of service science in China and chaired the first international conference of service science.
  • Managing joint programs between development team and research team. This helped transferred a number of technologies in Research to products, ranging from social business technologies, cloud computing technologies, visual analytics technologies and personal computing technologies. 

Hui has worked in both US and China as a global technical leader for signifiant period of time in his career and he is very familiar with multi-culture environment. 

Hui has got the PhD degree and Bachelor degree in Tsinghua University in Beijing, China.

Focus Area

Human Computer Interaction, Cognitive User Experience, Visual Analytics, Cloud Computing, Neural Networks

CISL Projects

CISL Publications


  1. . "Foreign language acquisition via artificial intelligence and extended reality: design and evaluation," Computer Assisted Language Learning (2021): pp. 1-29. [Publication, Abstract]


  1. . "A collaborative, immersive language learning environment using augmented panoramic imagery," 2020 6th International Conference of the Immersive Learning Research Network (iLRN), 2020, pp. 225–229. [Publication, Abstract]
  2. . "SpeakEasy: Browser-based automated multi-language intonation training. (A)," The Journal of the Acoustical Society of America 148, no. 4 (2020): 2697. [Publication, Abstract]
  3. . "Trust in AutoML: Exploring Information Needs for Establishing Trust in Automated Machine Learning Systems," In 25th International Conference on Intelligent User Interfaces (IUI ’20), March 17–20, 2020, Cagliari, Italy. ACM, New York, NY, USA, 11 pages [Publication, Abstract]
  4. . "A Virtual Mouse Interface for Supporting Multi-user Interactions," In Kurosu M. (eds) Human-Computer Interaction. Multimodal and Natural Interaction. HCII 2020. Lecture Notes in Computer Science, vol 12182. Springer, Cham. [Publication, Abstract]
  5. . "Browser Based Digital Sticky Notes for Design Thinking," DIS' 20 Companion: Companion Publication of the 2020 ACM Designing Interactive Systems Conference, July 2020, pp. 349–352. [Publication, Abstract]
  6. . "HUMAINE: Human Multi-Agent Immersive Negotiation Competition," In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems [Full Paper] [Publication, Abstract]


  1. . "The Rensselaer Mandarin Project — A Cognitive and Immersive Language Learning Environment," Proceedings of the AAAI Conference on Artificial Intelligence - Demonstration Track, vol. 33, pp. 9845-9846. 2019. [Publication, Abstract]
  2. . "Automated Mandarin tone classification using deep neural networks trained on a large speech dataset," The Journal of the Acoustical Society of America 145, no. 3 (2019): 1814-1814. [Publication, Abstract]
  3. . "Neuro-inspired Eye Tracking with Eye Movement Dynamics," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp. 9831-9840 [Publication, Abstract]
  4. . "Generalizing Eye Tracking with Bayesian Adversarial Learning," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp. 11907-11916 [Publication, Abstract]
  5. . "Multimodal, Multiuser Immersive Brainstorming and Scenario Planning for Intelligence Analysis," Proceedings of the 2019 IEEE International Symposium on Technologies for Homeland Security (HST), November 2019, pp.1-4. [Publication, Abstract]
  6. . "Reagent: Converting Ordinary Webpages into Interactive Software Agents," Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, July 2019, 6560-562.  [Publication, Abstract]
  7. . "Translating the Pen and Paper Brainstorming Process into a Cognitive and Immersive System," In: Kurosu M. (eds) Human-Computer Interaction. Recognition and Interaction Technologies. HCII 2019. Lecture Notes in Computer Science, vol 11567. Springer, Cham [Publication, Abstract]
  8. . "You talkin’to me? A practical attention-aware embodied agent," In Human-Computer Interaction–INTERACT, vol. 2019. 2019. [Publication, Abstract]
  9. . "Embodied Conversational AI Agents in a Multi-modal Multi-agent Competitive Dialogue," Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence Demos. Pages 6512-6514 [Publication, Abstract]
  10. . "Building Human-Scale Intelligent Immersive Spaces for Foreign Language Learning," Proceedings of iLRN 2018 Montana (2018): 94. [Publication, Abstract]
  11. . "Bayesian Hierarchical Dynamic Model for Human Action Recognition," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7733-7742. 2019. [Publication, Abstract]
  12. . "Language Learning in a Cognitive and Immersive Environment Using Contextualized Panoramic Imagery," In: Stephanidis C. (eds) HCI International 2019 - Posters. HCII 2019. Communications in Computer and Information Science, vol 1034. Springer, Cham [Publication, Abstract]
  13. . "Enabling Sensemaking for Intelligence Analysis in a Multi-user, Multimodal Cognitive and Immersive Environment," The Twelfth International Conference on Advances in Computer-Human Interactions, February 24, 2019, 7–14. [Publication, Abstract]
  14. . "A Coordinated Multi-channel Information Presentation Framework for Data Exploration," In International Conference on Human-Computer Interaction, pp. 153-173. Springer, Cham, 2019. [Publication, Abstract]


  1. . "CIRA: An Architecture for Building Configurable Immersive Smart-Rooms," In: Arai K., Kapoor S., Bhatia R. (eds) Intelligent Systems and Applications. IntelliSys 2018. Advances in Intelligent Systems and Computing, vol 869. Springer, Cham. [Publication, Abstract]