Haptics-enabled surgical training system with guidance using deep learning

Ehren Biglari, Marie Feng, John Quarles, Edward Y Sako, John H Calhoon, Ronald Rodriguez, Yusheng Feng

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper, we present a haptics-enabled surgical training system integrated with deep learning for characterization of particular procedures of experienced surgeons to guide medical residents-in-training with quantifiable patterns. The prototype of virtual reality surgical system is built for open-heart surgery with specific steps and biopsy operation. Two abstract surgical scenarios are designed to emulate incision and biopsy surgical procedures. Using deep learning algorithm (autoencoder), the two surgical procedures were trained and characterized. Results show that a vector with 30 real-valued components can quantify both surgical patterns. These values can be used to compare how a resident- in-training performs differently as opposed to an experienced surgeon so that quantifiable corrective training guidance can be provided.

Original languageEnglish (US)
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
PublisherSpringer Verlag
Pages267-278
Number of pages12
Volume9177
ISBN (Print)9783319206837
DOIs
StatePublished - 2015
Event9th International Conference on Universal Access in Human-Computer Interaction, UAHCI 2015 Held as Part of 17th International Conference on Human-Computer Interaction, HCI International 2015 - Los Angeles, United States
Duration: Aug 2 2015Aug 7 2015

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9177
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other9th International Conference on Universal Access in Human-Computer Interaction, UAHCI 2015 Held as Part of 17th International Conference on Human-Computer Interaction, HCI International 2015
CountryUnited States
CityLos Angeles
Period8/2/158/7/15

Keywords

  • Autoencoder
  • Deep learning algorithm
  • Haptic device
  • Machine learning
  • Motion tracking and quantification
  • Virtual surgical training system

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Fingerprint Dive into the research topics of 'Haptics-enabled surgical training system with guidance using deep learning'. Together they form a unique fingerprint.

  • Cite this

    Biglari, E., Feng, M., Quarles, J., Sako, E. Y., Calhoon, J. H., Rodriguez, R., & Feng, Y. (2015). Haptics-enabled surgical training system with guidance using deep learning. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 9177, pp. 267-278). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9177). Springer Verlag. https://doi.org/10.1007/978-3-319-20684-4_26