Deep Learning for Spatio-Temporal Localization of Temporomandibular Joint in Ultrasound Videos

Kristina Belikova, Aleksandra Zailer, Svetlana V. Tekucheva, Sergey N. Ermoljev, Dmitry V. Dylov

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Accurate interpretation of images of complex joints, such as the temporomandibular joint (TMJ), has become essential in a variety of clinical practices, ranging from the basic assessment of wear and tear (e.g., osteoarthritis) to intricate surgical interventions (e.g., arthroplasty). Today, this examination remains subjective and time-consuming, requiring comprehensive understanding of the joint's properties. Ultrasound (US) is the main medical imaging modality that, in addition to its many advantages, allows assessing the condition of the joint during its physiological movement. Therefore, there is a demand for an automatic and efficient method to track the joint landmarks and their movements in the ultrasound videos, promising facilitation of the tedious routine work of the US operators and a more objective metric of the joint health. To address the problem of landmark detection, we propose a method that combines 3D U-Net (which extracts spatial patterns with abstract features) and Long Short-Term Memory module (LSTM, for processing data as temporal 2D sequences of video frames). The method is evaluated on the dataset containing 13 sequences of TMJ motion recordings during the opening and the closing movements of the lower jaw. The approach proved functional and could be readily integrated into the current clinical practice.

Original languageEnglish
Title of host publicationProceedings - 2021 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2021
EditorsYufei Huang, Lukasz Kurgan, Feng Luo, Xiaohua Tony Hu, Yidong Chen, Edward Dougherty, Andrzej Kloczkowski, Yaohang Li
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1257-1261
Number of pages5
ISBN (Electronic)9781665401265
DOIs
Publication statusPublished - 2021
Event2021 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2021 - Virtual, Online, United States
Duration: 9 Dec 202112 Dec 2021

Publication series

NameProceedings - 2021 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2021

Conference

Conference2021 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2021
Country/TerritoryUnited States
CityVirtual, Online
Period9/12/2112/12/21

Keywords

  • bone joints
  • deep learning
  • LSTM
  • medical image tracking
  • U-Net
  • ultrasound imaging

Fingerprint

Dive into the research topics of 'Deep Learning for Spatio-Temporal Localization of Temporomandibular Joint in Ultrasound Videos'. Together they form a unique fingerprint.

Cite this