Yu NISHIYAMA (西山 悠)

PURPOSE: Scanning path planning is an essential technology for fully automated ultrasound (US) robotics. During biliary scanning, the subcostal boundary is critical body surface landmarks for scanning path planning but are often invisible, depending on the individual. This study developed a method of estimating the rib region for scanning path planning toward fully automated robotic US systems. METHODS: We proposed a method for determining the rib region using RGB-D images and respiratory variation. We hypothesized that detecting the rib region would be possible based on changes in body surface position due to breathing. We generated a depth difference image by finding the difference between the depth image taken at the resting inspiratory position and the depth image taken at the maximum inspiratory position, which clearly shows the rib region. The boundary position of the subcostal was then determined by applying training using the YOLOv5 object detection model to this depth difference image. RESULTS: In the experiments with healthy subjects, the proposed method of rib detection using the depth difference image marked an intersection over union (IoU) of 0.951 and average confidence of 0.77. The average error between the ground truth and predicted positions was 16.5 mm in 3D space. The results were superior to rib detection using only the RGB image. CONCLUSION: The proposed depth difference imaging method, which measures respiratory variation, was able to accurately estimate the rib region without contact and physician intervention. It will be useful for planning the scan path during the biliary imaging.

PURPOSE: In high-intensity focused ultrasound (HIFU) treatment of the kidney and liver, tracking the organs is essential because respiratory motions make continuous cauterization of the affected area difficult and may cause damage to other parts of the body. In this study, we propose a tracking system for rotational scanning, and propose and evaluate a method for estimating the angles of organs in ultrasound images. METHODS: We proposed AEMA, AEMAD, and AEMAD++ as methods for estimating the angles of organs in ultrasound images, using RUDS and a phantom to acquire 90-degree images of a kidney from the long-axis image to the short-axis image as a data set. Six datasets were used, with five for preliminary preparation and one for testing, while the initial position was shifted by 2 mm in the contralateral axis direction. The test data set was evaluated by estimating the angle using each method. RESULTS: The accuracy and processing speed of angle estimation for AEMA, AEMAD, and AEMAD++ were 23.8% and 0.33 FPS for AEMAD, 32.0% and 0.56 FPS for AEMAD, and 29.5% and 3.20 FPS for AEMAD++, with tolerance of ± 2.5 degrees. AEMAD++ offered the best speed and accuracy. CONCLUSION: In the phantom experiment, AEMAD++ showed the effectiveness of tracking the long-axis image of the kidney in rotational scanning. In the future, we will add either the area of surrounding organs or the internal structure of the kidney as a new feature to validate the results.