Abstract
We investigate a new framework of surgical instrument detection based on power-varying ultrasound images with simple and efficient pixel-wise intensity processing. Without using complicated feature extraction methods, we identified the instrument with an estimated optimal power level and by comparing pixel values of varying transducer power level images. The proposed framework exploits the physics of ultrasound imaging system by varying the transducer power level to effectively distinguish metallic surgical instruments from tissue. This power-varying image-guidance is motivated from our observations that ultrasound imaging at different power levels exhibit different contrast enhancement capabilities between tissue and instruments in ultrasound-guided robotic beating-heart surgery. Using lower transducer power levels (ranging from 40 to 75% of the rated lowest ultrasound power levels of the two tested ultrasound scanners) can effectively suppress the strong imaging artifacts from metallic instruments and thus, can be utilized together with the images from normal transducer power levels to enhance the separability between instrument and tissue, improving intraoperative instrument tracking accuracy from the acquired noisy ultrasound volumetric images. We performed experiments in phantoms and ex vivo hearts in water tank environments. The proposed multi-level power-varying ultrasound imaging approach can identify robotic instruments of high acoustic impedance from low-signal-to-noise-ratio ultrasound images by power adjustments.
















Similar content being viewed by others
References
Kesner SB, Howe RD (2011) Force control of flexible catheter robots for beating heart surgery. In: IEEE international conference on robotics and automation (ICRA), 2011. IEEE, pp 1589–1594
Bergeles C, Gosline AH, Vasilyev NV, Codd PJ, del Nido PJ, Dupont PE (2015) Concentric tube robot design and optimization based on task and anatomical constraints. IEEE Trans Robot 31(1):67–84
Dupont PE, Lock J, Itkowitz B, Butler E (2010) Design and control of concentric-tube robots. IEEE Trans Robot 26(2):209–225
Ataollahi A, Berra I, Vasilyev NV, Machaidze Z, Dupont PE (2016) Cardioscopic tool-delivery instrument for beating-heart surgery. IEEE/ASME Trans Mechatron 21(1):584–590
Bedell C, Lock J, Gosline A, Dupont PE (2011) Design optimization of concentric tube robots based on task and anatomical constraints. In: IEEE International Conference on Robotics and Automation (ICRA), 2011. IEEE, pp 398–403
Gilbert HB, Rucker DC, Webster III RJ (2016) Concentric tube robots: the state of the art and future directions. In: Robotics research. Springer, pp 253–269
Wu L, Song S, Wu K, Lim CM, Ren H (2017) Development of a compact continuum tubular robotic system for nasopharyngeal biopsy. Med Biol Eng Comput 403–417. [Online]. Available. doi:10.1007/s11517-016-1514-9
Boushaki MN, Liu C, Poignet P (2014) Task-space position control of concentric-tube robot with inaccurate kinematics using approximate jacobian. In: 2014 IEEE international conference on robotics and automation (ICRA). IEEE, pp 5877–5882
Nadeau C, Ren H, Krupa A, Dupont PE (2012) Target tracking in 3D ultrasound volumes by direct visual servoing. In: Hamlyn symposium on medical robotics, London, Royaume-Uni. 1st–2nd July, 01/07/2012–02/07/2012. [Online]. Available: http://hal.inria.fr/hal-00751755, pp 15–16
Suematsu Y, Marx GR, Stoll JA, DuPont PE, Cleveland RO, Howe RD, Triedman JK, Mihaljevic T, Mora BN, Savord BJ et al (2004) Three-dimensional echocardiography-guided beating-heart surgery without cardiopulmonary bypass: a feasibility study. J Thorac Cardiovasc Surg 128(4):579–587
Nadeau C, Ren H, Krupa A, Dupont PE (2014) Intensity-based visual servoing for instrument and tissue tracking in 3D ultrasound volumes. IEEE Trans Autom Sci Eng 99:1–5
Dupont P, Gosline A, Vasilyev N, Lock J, Butler E, Folk C, Cohen A, Chen R, Schmitz G, Ren H et al (2012) Concentric tube robots for minimally invasive surgery. In: Hamlyn Symposium on Medical Robotics, vol 7, p 8
Stoll J, Ren H, Dupont PE (2012) Passive markers for tracking surgical instruments in real-time 3D ultrasound imaging. IEEE Trans Med Imaging 31(3):563–575
Ren H, Dupont PE (2011) Tubular structure enhancement for surgical instrument detection in 3D ultrasound. In: International conference of the IEEE engineering in medicine and biology society, pp 7203–7206
Gupta S, Chauhan R, Sexana S (2004) Wavelet-based statistical approach for speckle reduction in medical ultrasound images. Med Biol Eng Comput 42(2):189–192
Acharya UR, Mookiah MRK, Sree SV, Afonso D, Sanches J, Shafique S, Nicolaides A, Pedro LM, e Fernandes JF, Suri JS (2013) Atherosclerotic plaque tissue characterization in 2D ultrasound longitudinal carotid scans for automated classification: a paradigm for stroke risk assessment. Med Biol Eng Comput 51(5):513–523
Migeon B, Marché P. (1997) In vitro 3D reconstruction of long bones using B-scan image processing. Med Biol Eng Comput 35(4):369–372
Ren H, Vasilyev NV, Dupont PE (2011) Detection of curved robots using 3D ultrasound. In: IROS 2011, IEEE/RSJ international conference on intelligent robots and systems, pp 2083–2089
Gosline AH, Vasilyev NV, Veeramani A, Wu M, Schmitz G, Chen R, Arabagi V, Pedro J, Dupont PE (2012) Metal MEMS tools for beating-heart tissue removal. In: IEEE international conference on robotics and automation (ICRA), 2012. IEEE, pp 1921–1926
Gosline AH, Vasilyev NV, Butler EJ, Folk C, Cohen A, Chen R, Lang N, Del Nido PJ, Dupont PE (2012) Percutaneous intracardiac beating-heart surgery using metal MEMS tissue approximation tools. Int J Robot Res 0278364912443718
Vasilyev NV, Gosline AH, Butler E, Lang N, Codd PJ, Yamauchi H, Feins EN, Folk CR, Cohen AL, Chen R et al (2013) Percutaneous steerable robotic tool delivery platform and metal microelectromechanical systems device for tissue manipulation and approximation closure of patent foramen ovale in an animal model. Circ Cardiovasc Interv 6(4):468–475
Crooks G, Sivak D (2011) Measures of trajectory ensemble disparity in nonequilibrium statistical dynamics. J Stat Mech: Theory Exp 2011:P06003
Otsu N (1975) A threshold selection method from gray-level histograms. Automatica 11:285–296
Kim S, Magnani A, Boyd S (2006) Robust Fisher discriminant analysis. Adv Neural Inf Proces Syst 18:659
Moreno P, Ho P, Vasconcelos N (2003) A Kullback-Leibler divergence based kernel for SVM classification in multimedia applications. Adv Neural Inf Proces Syst 16:1385–1393
Niknazar M, Vahdat B, Shamsollahi M, Sayyah M (2010) Application of Bhattacharyya distance as a dissimilarity index for automated prediction of epileptic seizures in rats. In: 2010 international conference on intelligent and advanced systems (ICIAS). IEEE, pp 1–5
Acknowledgements
This work is supported in-part by the Singapore Academic Research Fund under grant R-397-000-227-112, the NMRC Bedside and Bench under grant R-397-000-245-511, the Singapore Millennium Foundation under grant R-397-000-201-592, and the National Institutes of Health under grants R01HL124020 and R01HL087797. We thank Omar Ahmad for his assistance in this project when he was a visiting student in NUS.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
All involved studies have been approved and performed in accordance with ethical standards.
Conflict of interest
The authors declare that they have no conflict of interest.
Appendix
Appendix
1.1 Ultrasound imaging setups
We utilized both a clinical ultrasound imaging system, the Philips SONOS 7500 at Boston Children’s Hospital, and a lab-based ultrasound imaging system, Ultrasonix Sonix Touch, at the National University of Singapore, for cross-validating the consistency of power-varying experiments at both research labs. Both transducers allow users to adjust the transducer power levels either by graphical user interface or programming.
1.1.1 Philips SONOS 7500 ultrasound platform
The real-time interventional images were acquired through a Philips SONOS 7500 (www.philips.com) ultrasound imaging system. In addition to the imaging user interface of the SONOS system, a parallel stream of the same images was transferred to a custom workstation through the SONOS research interface. The image acquisition rate is about 28 volumes per second and varies slightly with the frequency settings. In the experiments of this article, standard settings of the image acquisition parameters were used, including 50% overall gain, 50% compression rate, frequency fusion mode 2, and high-density scan line spacing. The acquired gray-level ultrasonic volume image, V, can be defined as an M × N × P matrix. The individual voxel v(i,j,k) typically has an anisotropic spacing and represents the voxel intensity at the i th row, j th column, and k th slice, in the image volume space, which corresponds to the Cartesian coordinate, x = (x,y,z)T, of the ultrasound transducer system, in the physical spatial space. Here, x represents increasing azimuth, y represents increasing elevation, and z indicates increasing distance from the transducer. The resulting anisotropic spacing varies with acquisition depth settings, for example, 10-cm acquisition depth will produce an anisotropic volume with spacing {0.542 mm, 0.706 mm, 0.451 mm} in the x, y, and z directions, respectively.
The transducer power level of SONOS 7500 can be varied from −30 to 0 dB, in which 0 dB is a default level for visualizing both tissue and instruments. As shown in Fig. 17, we performed comparative imaging experiments for two different intra-cardiac instruments: the concentric tube robot end-effector, fabricated from NiTi, and braid-reinforced polyimide catheter tubing manufactured by Microlumen (Microlumen Inc.). For qualitative analysis, the instruments were imaged inside an ex vivo pig heart submerged in the water tank, and the images were recorded using different transducer power levels.
Comparison of acquired images from SONOS7500 at normal 0 dB power and at instrument-enhancing −23.1 dB in an ex vivo heart. a Imaging of a concentric tube robot; b imaging of a Microlumen catheter tube; c photographs of instruments used in panels a and b. Left: concentric tube robot; middle: microlumen catheter; right: experiment setup
1.1.2 Ultrasound experimental setup
The experimental setup is as shown in Fig. 18 for scanning a tube in a water tank and pig heart tissue environment.
Rights and permissions
About this article
Cite this article
Ren, H., Anuraj, B. & Dupont, P. Varying ultrasound power level to distinguish surgical instruments and tissue. Med Biol Eng Comput 56, 453–467 (2018). https://doi.org/10.1007/s11517-017-1695-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11517-017-1695-x