Skip to main content
Log in

Varying ultrasound power level to distinguish surgical instruments and tissue

  • Original Article
  • Published:
Medical & Biological Engineering & Computing Aims and scope Submit manuscript

Abstract

We investigate a new framework of surgical instrument detection based on power-varying ultrasound images with simple and efficient pixel-wise intensity processing. Without using complicated feature extraction methods, we identified the instrument with an estimated optimal power level and by comparing pixel values of varying transducer power level images. The proposed framework exploits the physics of ultrasound imaging system by varying the transducer power level to effectively distinguish metallic surgical instruments from tissue. This power-varying image-guidance is motivated from our observations that ultrasound imaging at different power levels exhibit different contrast enhancement capabilities between tissue and instruments in ultrasound-guided robotic beating-heart surgery. Using lower transducer power levels (ranging from 40 to 75% of the rated lowest ultrasound power levels of the two tested ultrasound scanners) can effectively suppress the strong imaging artifacts from metallic instruments and thus, can be utilized together with the images from normal transducer power levels to enhance the separability between instrument and tissue, improving intraoperative instrument tracking accuracy from the acquired noisy ultrasound volumetric images. We performed experiments in phantoms and ex vivo hearts in water tank environments. The proposed multi-level power-varying ultrasound imaging approach can identify robotic instruments of high acoustic impedance from low-signal-to-noise-ratio ultrasound images by power adjustments.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  1. Kesner SB, Howe RD (2011) Force control of flexible catheter robots for beating heart surgery. In: IEEE international conference on robotics and automation (ICRA), 2011. IEEE, pp 1589–1594

    Chapter  Google Scholar 

  2. Bergeles C, Gosline AH, Vasilyev NV, Codd PJ, del Nido PJ, Dupont PE (2015) Concentric tube robot design and optimization based on task and anatomical constraints. IEEE Trans Robot 31(1):67–84

    Article  PubMed  PubMed Central  Google Scholar 

  3. Dupont PE, Lock J, Itkowitz B, Butler E (2010) Design and control of concentric-tube robots. IEEE Trans Robot 26(2):209–225

    Article  PubMed  PubMed Central  Google Scholar 

  4. Ataollahi A, Berra I, Vasilyev NV, Machaidze Z, Dupont PE (2016) Cardioscopic tool-delivery instrument for beating-heart surgery. IEEE/ASME Trans Mechatron 21(1):584–590

    Article  Google Scholar 

  5. Bedell C, Lock J, Gosline A, Dupont PE (2011) Design optimization of concentric tube robots based on task and anatomical constraints. In: IEEE International Conference on Robotics and Automation (ICRA), 2011. IEEE, pp 398–403

    Chapter  Google Scholar 

  6. Gilbert HB, Rucker DC, Webster III RJ (2016) Concentric tube robots: the state of the art and future directions. In: Robotics research. Springer, pp 253–269

    Chapter  Google Scholar 

  7. Wu L, Song S, Wu K, Lim CM, Ren H (2017) Development of a compact continuum tubular robotic system for nasopharyngeal biopsy. Med Biol Eng Comput 403–417. [Online]. Available. doi:10.1007/s11517-016-1514-9

  8. Boushaki MN, Liu C, Poignet P (2014) Task-space position control of concentric-tube robot with inaccurate kinematics using approximate jacobian. In: 2014 IEEE international conference on robotics and automation (ICRA). IEEE, pp 5877–5882

    Chapter  Google Scholar 

  9. Nadeau C, Ren H, Krupa A, Dupont PE (2012) Target tracking in 3D ultrasound volumes by direct visual servoing. In: Hamlyn symposium on medical robotics, London, Royaume-Uni. 1st–2nd July, 01/07/2012–02/07/2012. [Online]. Available: http://hal.inria.fr/hal-00751755, pp 15–16

    Google Scholar 

  10. Suematsu Y, Marx GR, Stoll JA, DuPont PE, Cleveland RO, Howe RD, Triedman JK, Mihaljevic T, Mora BN, Savord BJ et al (2004) Three-dimensional echocardiography-guided beating-heart surgery without cardiopulmonary bypass: a feasibility study. J Thorac Cardiovasc Surg 128(4):579–587

    Article  PubMed  Google Scholar 

  11. Nadeau C, Ren H, Krupa A, Dupont PE (2014) Intensity-based visual servoing for instrument and tissue tracking in 3D ultrasound volumes. IEEE Trans Autom Sci Eng 99:1–5

    Google Scholar 

  12. Dupont P, Gosline A, Vasilyev N, Lock J, Butler E, Folk C, Cohen A, Chen R, Schmitz G, Ren H et al (2012) Concentric tube robots for minimally invasive surgery. In: Hamlyn Symposium on Medical Robotics, vol 7, p 8

    Google Scholar 

  13. Stoll J, Ren H, Dupont PE (2012) Passive markers for tracking surgical instruments in real-time 3D ultrasound imaging. IEEE Trans Med Imaging 31(3):563–575

    Article  PubMed  Google Scholar 

  14. Ren H, Dupont PE (2011) Tubular structure enhancement for surgical instrument detection in 3D ultrasound. In: International conference of the IEEE engineering in medicine and biology society, pp 7203–7206

    Google Scholar 

  15. Gupta S, Chauhan R, Sexana S (2004) Wavelet-based statistical approach for speckle reduction in medical ultrasound images. Med Biol Eng Comput 42(2):189–192

    Article  CAS  PubMed  Google Scholar 

  16. Acharya UR, Mookiah MRK, Sree SV, Afonso D, Sanches J, Shafique S, Nicolaides A, Pedro LM, e Fernandes JF, Suri JS (2013) Atherosclerotic plaque tissue characterization in 2D ultrasound longitudinal carotid scans for automated classification: a paradigm for stroke risk assessment. Med Biol Eng Comput 51(5):513–523

    Article  PubMed  Google Scholar 

  17. Migeon B, Marché P. (1997) In vitro 3D reconstruction of long bones using B-scan image processing. Med Biol Eng Comput 35(4):369–372

    Article  CAS  PubMed  Google Scholar 

  18. Ren H, Vasilyev NV, Dupont PE (2011) Detection of curved robots using 3D ultrasound. In: IROS 2011, IEEE/RSJ international conference on intelligent robots and systems, pp 2083–2089

    Chapter  Google Scholar 

  19. Gosline AH, Vasilyev NV, Veeramani A, Wu M, Schmitz G, Chen R, Arabagi V, Pedro J, Dupont PE (2012) Metal MEMS tools for beating-heart tissue removal. In: IEEE international conference on robotics and automation (ICRA), 2012. IEEE, pp 1921–1926

    Chapter  Google Scholar 

  20. Gosline AH, Vasilyev NV, Butler EJ, Folk C, Cohen A, Chen R, Lang N, Del Nido PJ, Dupont PE (2012) Percutaneous intracardiac beating-heart surgery using metal MEMS tissue approximation tools. Int J Robot Res 0278364912443718

  21. Vasilyev NV, Gosline AH, Butler E, Lang N, Codd PJ, Yamauchi H, Feins EN, Folk CR, Cohen AL, Chen R et al (2013) Percutaneous steerable robotic tool delivery platform and metal microelectromechanical systems device for tissue manipulation and approximation closure of patent foramen ovale in an animal model. Circ Cardiovasc Interv 6(4):468–475

    Article  PubMed  Google Scholar 

  22. Crooks G, Sivak D (2011) Measures of trajectory ensemble disparity in nonequilibrium statistical dynamics. J Stat Mech: Theory Exp 2011:P06003

    Google Scholar 

  23. Otsu N (1975) A threshold selection method from gray-level histograms. Automatica 11:285–296

    Article  Google Scholar 

  24. Kim S, Magnani A, Boyd S (2006) Robust Fisher discriminant analysis. Adv Neural Inf Proces Syst 18:659

    Google Scholar 

  25. Moreno P, Ho P, Vasconcelos N (2003) A Kullback-Leibler divergence based kernel for SVM classification in multimedia applications. Adv Neural Inf Proces Syst 16:1385–1393

    Google Scholar 

  26. Niknazar M, Vahdat B, Shamsollahi M, Sayyah M (2010) Application of Bhattacharyya distance as a dissimilarity index for automated prediction of epileptic seizures in rats. In: 2010 international conference on intelligent and advanced systems (ICIAS). IEEE, pp 1–5

    Google Scholar 

Download references

Acknowledgements

This work is supported in-part by the Singapore Academic Research Fund under grant R-397-000-227-112, the NMRC Bedside and Bench under grant R-397-000-245-511, the Singapore Millennium Foundation under grant R-397-000-201-592, and the National Institutes of Health under grants R01HL124020 and R01HL087797. We thank Omar Ahmad for his assistance in this project when he was a visiting student in NUS.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hongliang Ren.

Ethics declarations

All involved studies have been approved and performed in accordance with ethical standards.

Conflict of interest

The authors declare that they have no conflict of interest.

Appendix

Appendix

1.1 Ultrasound imaging setups

We utilized both a clinical ultrasound imaging system, the Philips SONOS 7500 at Boston Children’s Hospital, and a lab-based ultrasound imaging system, Ultrasonix Sonix Touch, at the National University of Singapore, for cross-validating the consistency of power-varying experiments at both research labs. Both transducers allow users to adjust the transducer power levels either by graphical user interface or programming.

1.1.1 Philips SONOS 7500 ultrasound platform

The real-time interventional images were acquired through a Philips SONOS 7500 (www.philips.com) ultrasound imaging system. In addition to the imaging user interface of the SONOS system, a parallel stream of the same images was transferred to a custom workstation through the SONOS research interface. The image acquisition rate is about 28 volumes per second and varies slightly with the frequency settings. In the experiments of this article, standard settings of the image acquisition parameters were used, including 50% overall gain, 50% compression rate, frequency fusion mode 2, and high-density scan line spacing. The acquired gray-level ultrasonic volume image, V, can be defined as an M × N × P matrix. The individual voxel v(i,j,k) typically has an anisotropic spacing and represents the voxel intensity at the i th row, j th column, and k th slice, in the image volume space, which corresponds to the Cartesian coordinate, x = (x,y,z)T, of the ultrasound transducer system, in the physical spatial space. Here, x represents increasing azimuth, y represents increasing elevation, and z indicates increasing distance from the transducer. The resulting anisotropic spacing varies with acquisition depth settings, for example, 10-cm acquisition depth will produce an anisotropic volume with spacing {0.542 mm, 0.706 mm, 0.451 mm} in the x, y, and z directions, respectively.

The transducer power level of SONOS 7500 can be varied from −30 to 0 dB, in which 0 dB is a default level for visualizing both tissue and instruments. As shown in Fig. 17, we performed comparative imaging experiments for two different intra-cardiac instruments: the concentric tube robot end-effector, fabricated from NiTi, and braid-reinforced polyimide catheter tubing manufactured by Microlumen (Microlumen Inc.). For qualitative analysis, the instruments were imaged inside an ex vivo pig heart submerged in the water tank, and the images were recorded using different transducer power levels.

Fig. 17
figure 17

Comparison of acquired images from SONOS7500 at normal 0 dB power and at instrument-enhancing −23.1 dB in an ex vivo heart. a Imaging of a concentric tube robot; b imaging of a Microlumen catheter tube; c photographs of instruments used in panels a and b. Left: concentric tube robot; middle: microlumen catheter; right: experiment setup

1.1.2 Ultrasound experimental setup

The experimental setup is as shown in Fig. 18 for scanning a tube in a water tank and pig heart tissue environment.

Fig. 18
figure 18

Experimental setup using Ultrasonix machine for scanning (left) the water tank and (right) pig heart tissue

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ren, H., Anuraj, B. & Dupont, P. Varying ultrasound power level to distinguish surgical instruments and tissue. Med Biol Eng Comput 56, 453–467 (2018). https://doi.org/10.1007/s11517-017-1695-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11517-017-1695-x

Keywords